SlideShare a Scribd company logo
MCS 7103: Machine Learning
Simon Alex and Nambaale
Support Vector Machines
Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
Overview
1 Support Vector Machines
Applications of SVM
What is Machine Learning?
What Is SVM?
Features of SVM
How Does SVM Work?
Non-Linear SVM
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
Applications of Support Vector Machines
Text Categorization Bioinformatics Face Recognition Image Classification
Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
What is Machine Learning?
Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
Supervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
Unsupervised Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
Type of Problems in Machine Learning
Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
Where are Support Vector Machines?
Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
What is Support Vector Machine?
Support Vector Machine (SVM) is a supervised learning method used
for classification and regression.
SVM separates data using a hyperplane which acts like a decision
boundary between the various classes.
SVM works well for classifying higher-dimensional data (lots of fea-
tures).
Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
Features of Support Vector Machine
SVM is a supervised learning algorithm.
It can be used for both classification and regression problems.
SVM can be used for classifying non-linear data using the kernel trick.
Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
How Does SVM Work?
Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
What is a Support Vector in SVM
Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
Non-Linear Support Vector Machine
Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
Defining the Separating Hyperplane
Form of equation defining the decision surface separating the classes is
a hyperplane of the form:
wT
x + b = 0
Where:
w is a weight vector
x is an input vector
b is bias
Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
Defining the Separating Hyperplane
Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
Support Vector Classification
In practice, SVM uses SVC to classify data.
Different kernels can be used with SVC.
These kernels include: linear, RBF and polynomial.
Some kernels work better than others for a given dataset.
Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
Gamma and C
Gamma controls the shape of the ’peaks’ where the points are raised.
The gamma parameter defines the degree of non-linearity, with low val-
ues tending high linearity and high values leading to high non-linearity.
Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
Influence of Gamma on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
Gamma and C
C controls the cost of misclassification on the training data.
A high C tries to minimize the misclassification of training data leading
to overfitting∗ and a low value tries to maintain a smooth classifica-
tion.
∗
Underfitting is where the model neither performs well in training nor testing.
Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
Influence of C on Training Data
Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
Cross-Validation
Cross-Validation is a statistical method of evaluating and comparing
learning algorithms by dividing data into two segments: one used to
learn or train a model and the other used to validate the model.
The basic form of cross-validation is k-fold cross-validation.
Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
K-Fold Cross Validation
Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
Questions?
Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
SVM Use Case
Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28

More Related Content

What's hot

Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
Simplilearn
 
Support vector machine
Support vector machineSupport vector machine
Support vector machine
Rishabh Gupta
 
Support vector machines (svm)
Support vector machines (svm)Support vector machines (svm)
Support vector machines (svm)
Sharayu Patil
 
Credit card fraud detection using python machine learning
Credit card fraud detection using python machine learningCredit card fraud detection using python machine learning
Credit card fraud detection using python machine learning
Sandeep Garg
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural Network
Yan Xu
 
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
Simplilearn
 
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
Edureka!
 
Introduction to Transformers for NLP - Olga Petrova
Introduction to Transformers for NLP - Olga PetrovaIntroduction to Transformers for NLP - Olga Petrova
Introduction to Transformers for NLP - Olga Petrova
Alexey Grigorev
 
Classification Based Machine Learning Algorithms
Classification Based Machine Learning AlgorithmsClassification Based Machine Learning Algorithms
Classification Based Machine Learning Algorithms
Md. Main Uddin Rony
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
Devashish Shanker
 
Naive Bayes
Naive BayesNaive Bayes
Naive Bayes
CloudxLab
 
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
Simplilearn
 
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Edureka!
 
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
Edureka!
 
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
Simplilearn
 
Machine Learning - Ensemble Methods
Machine Learning - Ensemble MethodsMachine Learning - Ensemble Methods
Machine Learning - Ensemble Methods
Andrew Ferlitsch
 
Random forest algorithm
Random forest algorithmRandom forest algorithm
Random forest algorithm
Rashid Ansari
 
Support Vector Machine ppt presentation
Support Vector Machine ppt presentationSupport Vector Machine ppt presentation
Support Vector Machine ppt presentation
AyanaRukasar
 
Module-3_SVM_Kernel_KNN.pptx
Module-3_SVM_Kernel_KNN.pptxModule-3_SVM_Kernel_KNN.pptx
Module-3_SVM_Kernel_KNN.pptx
VaishaliBagewadikar
 
Feature selection
Feature selectionFeature selection
Feature selection
Dong Guo
 

What's hot (20)

Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
Backpropagation And Gradient Descent In Neural Networks | Neural Network Tuto...
 
Support vector machine
Support vector machineSupport vector machine
Support vector machine
 
Support vector machines (svm)
Support vector machines (svm)Support vector machines (svm)
Support vector machines (svm)
 
Credit card fraud detection using python machine learning
Credit card fraud detection using python machine learningCredit card fraud detection using python machine learning
Credit card fraud detection using python machine learning
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural Network
 
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
Machine Learning Algorithms | Machine Learning Tutorial | Data Science Algori...
 
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
KNN Algorithm using Python | How KNN Algorithm works | Python Data Science Tr...
 
Introduction to Transformers for NLP - Olga Petrova
Introduction to Transformers for NLP - Olga PetrovaIntroduction to Transformers for NLP - Olga Petrova
Introduction to Transformers for NLP - Olga Petrova
 
Classification Based Machine Learning Algorithms
Classification Based Machine Learning AlgorithmsClassification Based Machine Learning Algorithms
Classification Based Machine Learning Algorithms
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
 
Naive Bayes
Naive BayesNaive Bayes
Naive Bayes
 
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
K Means Clustering Algorithm | K Means Clustering Example | Machine Learning ...
 
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
Scikit Learn Tutorial | Machine Learning with Python | Python for Data Scienc...
 
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
Python Machine Learning Tutorial | Machine Learning Algorithms | Python Train...
 
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 2 | Machine Learning Tutorial For Beginners ...
 
Machine Learning - Ensemble Methods
Machine Learning - Ensemble MethodsMachine Learning - Ensemble Methods
Machine Learning - Ensemble Methods
 
Random forest algorithm
Random forest algorithmRandom forest algorithm
Random forest algorithm
 
Support Vector Machine ppt presentation
Support Vector Machine ppt presentationSupport Vector Machine ppt presentation
Support Vector Machine ppt presentation
 
Module-3_SVM_Kernel_KNN.pptx
Module-3_SVM_Kernel_KNN.pptxModule-3_SVM_Kernel_KNN.pptx
Module-3_SVM_Kernel_KNN.pptx
 
Feature selection
Feature selectionFeature selection
Feature selection
 

Recently uploaded

National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 

Recently uploaded (20)

National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 

Support vector-machines-presentation

  • 1. MCS 7103: Machine Learning Simon Alex and Nambaale Support Vector Machines Simon Alex and Nambaale MCS 7101 October 8, 2019 1 / 28
  • 2. Overview 1 Support Vector Machines Applications of SVM What is Machine Learning? What Is SVM? Features of SVM How Does SVM Work? Non-Linear SVM SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 2 / 28
  • 3. Applications of Support Vector Machines Text Categorization Bioinformatics Face Recognition Image Classification Simon Alex and Nambaale MCS 7101 October 8, 2019 3 / 28
  • 4. What is Machine Learning? Simon Alex and Nambaale MCS 7101 October 8, 2019 4 / 28
  • 5. Supervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 5 / 28
  • 6. Unsupervised Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 6 / 28
  • 7. Type of Problems in Machine Learning Simon Alex and Nambaale MCS 7101 October 8, 2019 7 / 28
  • 8. Where are Support Vector Machines? Simon Alex and Nambaale MCS 7101 October 8, 2019 8 / 28
  • 9. What is Support Vector Machine? Support Vector Machine (SVM) is a supervised learning method used for classification and regression. SVM separates data using a hyperplane which acts like a decision boundary between the various classes. SVM works well for classifying higher-dimensional data (lots of fea- tures). Simon Alex and Nambaale MCS 7101 October 8, 2019 9 / 28
  • 10. Features of Support Vector Machine SVM is a supervised learning algorithm. It can be used for both classification and regression problems. SVM can be used for classifying non-linear data using the kernel trick. Simon Alex and Nambaale MCS 7101 October 8, 2019 10 / 28
  • 11. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 11 / 28
  • 12. How Does SVM Work? Simon Alex and Nambaale MCS 7101 October 8, 2019 12 / 28
  • 13. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 13 / 28
  • 14. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 14 / 28
  • 15. What is a Support Vector in SVM Simon Alex and Nambaale MCS 7101 October 8, 2019 15 / 28
  • 16. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 16 / 28
  • 17. Non-Linear Support Vector Machine Simon Alex and Nambaale MCS 7101 October 8, 2019 17 / 28
  • 18. Defining the Separating Hyperplane Form of equation defining the decision surface separating the classes is a hyperplane of the form: wT x + b = 0 Where: w is a weight vector x is an input vector b is bias Simon Alex and Nambaale MCS 7101 October 8, 2019 18 / 28
  • 19. Defining the Separating Hyperplane Simon Alex and Nambaale MCS 7101 October 8, 2019 19 / 28
  • 20. Support Vector Classification In practice, SVM uses SVC to classify data. Different kernels can be used with SVC. These kernels include: linear, RBF and polynomial. Some kernels work better than others for a given dataset. Simon Alex and Nambaale MCS 7101 October 8, 2019 20 / 28
  • 21. Gamma and C Gamma controls the shape of the ’peaks’ where the points are raised. The gamma parameter defines the degree of non-linearity, with low val- ues tending high linearity and high values leading to high non-linearity. Simon Alex and Nambaale MCS 7101 October 8, 2019 21 / 28
  • 22. Influence of Gamma on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 22 / 28
  • 23. Gamma and C C controls the cost of misclassification on the training data. A high C tries to minimize the misclassification of training data leading to overfitting∗ and a low value tries to maintain a smooth classifica- tion. ∗ Underfitting is where the model neither performs well in training nor testing. Simon Alex and Nambaale MCS 7101 October 8, 2019 23 / 28
  • 24. Influence of C on Training Data Simon Alex and Nambaale MCS 7101 October 8, 2019 24 / 28
  • 25. Cross-Validation Cross-Validation is a statistical method of evaluating and comparing learning algorithms by dividing data into two segments: one used to learn or train a model and the other used to validate the model. The basic form of cross-validation is k-fold cross-validation. Simon Alex and Nambaale MCS 7101 October 8, 2019 25 / 28
  • 26. K-Fold Cross Validation Simon Alex and Nambaale MCS 7101 October 8, 2019 26 / 28
  • 27. Questions? Simon Alex and Nambaale MCS 7101 October 8, 2019 27 / 28
  • 28. SVM Use Case Simon Alex and Nambaale MCS 7101 October 8, 2019 28 / 28