SlideShare a Scribd company logo
Introduction to
Deep Learning with
Cognitive Toolkit (CNTK)
Marvin Heng
Blog : http://hmheng.pinsland.com
Twitter : @hmheng
YouTube: http://bit.ly/hmheng_yt
SlideShare: http://bit.ly/hmheng_ss
Github: https://github.com/hmheng
HMHENG.
PINSLAND.COM
Microsoft
Cognitive Service
Microsoft
Cognitive ToolKit
Who is Marvin?
Software + Web Developer
AI Enthusiast
Blog : https://hmheng.pinsland.com
Twitter : @hmheng
YouTube: http://bit.ly/hmheng_yt
SlideShare: http://bit.ly/hmheng_ss
Github: https://github.com/hmheng
Scan & Subscribe!
hmheng.pinsland.com
HMHENG.
PINSLAND.COM
HMHENG.
PINSLAND.COM
Started from AI, ML then Deep Learning…
HMHENG.
PINSLAND.COM
What is Deep Learning?
A Subfield of Machine Learning
Self Learning
More complex than Machine Learning
Neural Networks mimics the neural systems in our brains.
HMHENG.
PINSLAND.COM
What is Deep Learning?
HMHENG.
PINSLAND.COM
Credit: Nvidia
What is Microsoft Cognitive ToolKit (CNTK)?
HMHENG.
PINSLAND.COM
HMHENG.
PINSLAND.COM
Behind the Scenes
Microsoft Cognitive Toolkit (CNTK)?
• Open-Source Development on GitHub (released 2.5 on 15th Mar 18)
• Fast
• Optimized for GPUs & Libraries
• Best-in-Class multi-GPU/Multi-server algorithms
• Flexible
• BrainScript, C#/.NET, C++, Python, Network Definition Language, Model Editing Language(MEL)
• Linux, Windows and Docker Container
• Ease of Use & Wide-range of Support
• FF-NN, CNN, RNN, LSTM, DSSM,…
HMHENG.
PINSLAND.COM
Microsoft Cognitive Toolkit (CNTK)
HMHENG.
PINSLAND.COM
Arbitrary Neural
Networks Expression
Composing simple building
blocks into complex
computational networks.
Production
Ready
State-of-the-art accuracy
Efficient
Scalable to Multi-GPU/Multi-
Server
Microsoft Cognitive Toolkit
HMHENG.
PINSLAND.COM
Design
Number of layers,
number of units
Dependent on
concept
complexity
Experimentation
often required
Activation
Function
Enables non-
linear models
Examples include
sigmoid,
hyperbolic
tangent, ReLU,
softmax, …
Loss
Function
Measure the
performance
during training
Examples include
cross entropy
Training
Mechanism for
getting optimal
weights
Overfitting
Stop models from
over-optimizing
on training data
set.
Microsoft Cognitive Toolkit (CNTK)
HMHENG.
PINSLAND.COM
Windows
CPU|GPU
NuGet – CPU | NuGet – GPU | NuGet – UWP CPU
Linux
CPU|GPU|Docker – CPU| Docker – GPU
Requires OpenMPI
MacOS
Docker – CPU
Cloud
Data Science Virtual Machine | Azure Notebooks
Azure Batch AI Training (CPU/GPU) | Project BrainWave (FPGA)
Sharing
Marvin Heng
Blog : http://hmheng.pinsland.com
Twitter : @hmheng
YouTube: http://bit.ly/hmheng_yt
SlideShare: http://bit.ly/hmheng_ss
Github: https://github.com/hmheng
Microsoft
Cognitive Service
HMHENG.
PINSLAND.COM
Microsoft
Cognitive ToolKit
What is Deep Learning
HMHENG.
PINSLAND.COM
Open Neural Network Exchange
HMHENG.
PINSLAND.COM
• An open format to represent deep learning models.
• Collaboration between Microsoft, AWS and Facebook.
• Supported by community of partners like Intel, ARM, AMD, nvidia,
etc.
• A share library with Caffe2, PyTorch, MXNet, Cognitive Toolkit.
• Permissive MIT license and no patents.
ONNX Aims
HMHENG.
PINSLAND.COM
• Allow interoperability between frameworks
• CNTK, Caffe2 and PyTorch
• Allow hardware vendor to focus on one IR in their backend
optimization
• Allow training in one toolkit and deploy in another.
ONNX Aims
HMHENG.
PINSLAND.COM
• Allow interoperability between frameworks
• CNTK, Caffe2 and PyTorch
• Allow hardware vendor to focus on one IR in their backend
optimization
• Allow training in one toolkit and deploy in another.
More…
CTNK.ai
Tutorial, Source Code, Example
@ https://github.com/Microsoft/CNTK
ONNX.ai
HMHENG.
PINSLAND.COM
Marvin Heng
Blog : http://hmheng.pinsland.com
Twitter : @hmheng
YouTube: http://bit.ly/hmheng_yt
SlideShare: http://bit.ly/hmheng_ss
Github: https://github.com/hmheng
Thank
You
HMHENG.
PINSLAND.COM
Introduction to
Deep Learning with
Cognitive Toolkit (CNTK)
Marvin Heng
Blog : http://hmheng.pinsland.com
Twitter : @hmheng
YouTube: http://bit.ly/hmheng_yt
SlideShare: http://bit.ly/hmheng_ss
Github: https://github.com/hmheng
HMHENG.
PINSLAND.COM
Microsoft
Cognitive Service
Microsoft
Cognitive ToolKit

More Related Content

Similar to AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit

Teaching Machine Learning with Physical Computing - July 2023
Teaching Machine Learning with Physical Computing - July 2023Teaching Machine Learning with Physical Computing - July 2023
Teaching Machine Learning with Physical Computing - July 2023
Hal Speed
 
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Matthew Russell
 
Onnx at lf oss na 20200629 v5
Onnx at lf oss na 20200629 v5Onnx at lf oss na 20200629 v5
Onnx at lf oss na 20200629 v5
ISSIP
 
python programming.pptx
python programming.pptxpython programming.pptx
python programming.pptx
Kaviya452563
 
Welcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdfWelcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdf
digitaldnyan
 
Welcome to Python Programming Language.pptx
Welcome to Python Programming Language.pptxWelcome to Python Programming Language.pptx
Welcome to Python Programming Language.pptx
digitaldnyan
 
Welcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdfWelcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdf
digitaldnyan
 
Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
 Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017 Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
BigchainDB
 
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
Simplilearn
 
Introduction to EasyBuild: Tutorial Part 1
Introduction to EasyBuild: Tutorial Part 1Introduction to EasyBuild: Tutorial Part 1
Introduction to EasyBuild: Tutorial Part 1
inside-BigData.com
 
DIY Applied Machine Learning
DIY Applied Machine LearningDIY Applied Machine Learning
DIY Applied Machine Learning
Tarek Hoteit
 
Combining Machine Learning with Physical Computing - June 2023
Combining Machine Learning with Physical Computing - June 2023Combining Machine Learning with Physical Computing - June 2023
Combining Machine Learning with Physical Computing - June 2023
Hal Speed
 
Python for security professionals by katoh jeremiah [py con ng 2018]
Python for security professionals by katoh jeremiah [py con ng 2018]Python for security professionals by katoh jeremiah [py con ng 2018]
Python for security professionals by katoh jeremiah [py con ng 2018]
jerrykatoh
 
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
Codemotion
 
Combining Machine Learning with Physical Computing - June 2022
Combining Machine Learning with Physical Computing - June 2022Combining Machine Learning with Physical Computing - June 2022
Combining Machine Learning with Physical Computing - June 2022
Hal Speed
 
CloudEngine at Dev8D 2011
CloudEngine at Dev8D 2011CloudEngine at Dev8D 2011
CloudEngine at Dev8D 2011
Nick Freear
 
2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits
Timothy Spann
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP models
OVHcloud
 
Manual de ayuda: Programación desde el inicio en Python.
Manual de ayuda: Programación desde el inicio en Python.Manual de ayuda: Programación desde el inicio en Python.
Manual de ayuda: Programación desde el inicio en Python.
cjgaland
 
#TOA13 - Tech Opoen Air Recommender Hackathon
#TOA13 - Tech Opoen Air Recommender Hackathon#TOA13 - Tech Opoen Air Recommender Hackathon
#TOA13 - Tech Opoen Air Recommender HackathonTorben Brodt
 

Similar to AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit (20)

Teaching Machine Learning with Physical Computing - July 2023
Teaching Machine Learning with Physical Computing - July 2023Teaching Machine Learning with Physical Computing - July 2023
Teaching Machine Learning with Physical Computing - July 2023
 
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
 
Onnx at lf oss na 20200629 v5
Onnx at lf oss na 20200629 v5Onnx at lf oss na 20200629 v5
Onnx at lf oss na 20200629 v5
 
python programming.pptx
python programming.pptxpython programming.pptx
python programming.pptx
 
Welcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdfWelcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdf
 
Welcome to Python Programming Language.pptx
Welcome to Python Programming Language.pptxWelcome to Python Programming Language.pptx
Welcome to Python Programming Language.pptx
 
Welcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdfWelcome to Python Programming Language.pdf
Welcome to Python Programming Language.pdf
 
Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
 Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017 Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
Blockchain Beyond Finance - Cronos Groep - Jan 17, 2017
 
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
Deep Learning Frameworks 2019 | Which Deep Learning Framework To Use | Deep L...
 
Introduction to EasyBuild: Tutorial Part 1
Introduction to EasyBuild: Tutorial Part 1Introduction to EasyBuild: Tutorial Part 1
Introduction to EasyBuild: Tutorial Part 1
 
DIY Applied Machine Learning
DIY Applied Machine LearningDIY Applied Machine Learning
DIY Applied Machine Learning
 
Combining Machine Learning with Physical Computing - June 2023
Combining Machine Learning with Physical Computing - June 2023Combining Machine Learning with Physical Computing - June 2023
Combining Machine Learning with Physical Computing - June 2023
 
Python for security professionals by katoh jeremiah [py con ng 2018]
Python for security professionals by katoh jeremiah [py con ng 2018]Python for security professionals by katoh jeremiah [py con ng 2018]
Python for security professionals by katoh jeremiah [py con ng 2018]
 
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
M. Valoriani, A. Musone - Game Changing: Mixed Reality + Machine Learning = ?...
 
Combining Machine Learning with Physical Computing - June 2022
Combining Machine Learning with Physical Computing - June 2022Combining Machine Learning with Physical Computing - June 2022
Combining Machine Learning with Physical Computing - June 2022
 
CloudEngine at Dev8D 2011
CloudEngine at Dev8D 2011CloudEngine at Dev8D 2011
CloudEngine at Dev8D 2011
 
2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP models
 
Manual de ayuda: Programación desde el inicio en Python.
Manual de ayuda: Programación desde el inicio en Python.Manual de ayuda: Programación desde el inicio en Python.
Manual de ayuda: Programación desde el inicio en Python.
 
#TOA13 - Tech Opoen Air Recommender Hackathon
#TOA13 - Tech Opoen Air Recommender Hackathon#TOA13 - Tech Opoen Air Recommender Hackathon
#TOA13 - Tech Opoen Air Recommender Hackathon
 

More from Marvin Heng

Accelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft CertificationsAccelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft Certifications
Marvin Heng
 
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Marvin Heng
 
Microsoft Cognitive Services at a Glance
Microsoft Cognitive Services at a GlanceMicrosoft Cognitive Services at a Glance
Microsoft Cognitive Services at a Glance
Marvin Heng
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extraction
Marvin Heng
 
A Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service IA Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service I
Marvin Heng
 
A Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services IIA Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services II
Marvin Heng
 
AI and App Accessibility
AI and App AccessibilityAI and App Accessibility
AI and App Accessibility
Marvin Heng
 
What's New With Azure AI
What's New With Azure AIWhat's New With Azure AI
What's New With Azure AI
Marvin Heng
 
Intelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFrameworkIntelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFramework
Marvin Heng
 
Using AI to solve business challenges
Using AI to solve business challengesUsing AI to solve business challenges
Using AI to solve business challenges
Marvin Heng
 
Intelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom VisionIntelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom Vision
Marvin Heng
 
Azure Cognitive Services for Developers
Azure Cognitive Services for DevelopersAzure Cognitive Services for Developers
Azure Cognitive Services for Developers
Marvin Heng
 
Bot & AI - A Bot for Productivity
Bot & AI - A Bot for ProductivityBot & AI - A Bot for Productivity
Bot & AI - A Bot for Productivity
Marvin Heng
 
Artificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I SeeArtificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I See
Marvin Heng
 
Handwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive ServicesHandwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive Services
Marvin Heng
 
Create a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your CustomersCreate a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your Customers
Marvin Heng
 
Facial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET CoreFacial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET Core
Marvin Heng
 
AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.
Marvin Heng
 
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & AzureArtificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Marvin Heng
 
AI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You TypedAI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You Typed
Marvin Heng
 

More from Marvin Heng (20)

Accelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft CertificationsAccelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft Certifications
 
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
 
Microsoft Cognitive Services at a Glance
Microsoft Cognitive Services at a GlanceMicrosoft Cognitive Services at a Glance
Microsoft Cognitive Services at a Glance
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extraction
 
A Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service IA Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service I
 
A Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services IIA Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services II
 
AI and App Accessibility
AI and App AccessibilityAI and App Accessibility
AI and App Accessibility
 
What's New With Azure AI
What's New With Azure AIWhat's New With Azure AI
What's New With Azure AI
 
Intelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFrameworkIntelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFramework
 
Using AI to solve business challenges
Using AI to solve business challengesUsing AI to solve business challenges
Using AI to solve business challenges
 
Intelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom VisionIntelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom Vision
 
Azure Cognitive Services for Developers
Azure Cognitive Services for DevelopersAzure Cognitive Services for Developers
Azure Cognitive Services for Developers
 
Bot & AI - A Bot for Productivity
Bot & AI - A Bot for ProductivityBot & AI - A Bot for Productivity
Bot & AI - A Bot for Productivity
 
Artificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I SeeArtificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I See
 
Handwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive ServicesHandwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive Services
 
Create a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your CustomersCreate a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your Customers
 
Facial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET CoreFacial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET Core
 
AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.
 
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & AzureArtificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
 
AI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You TypedAI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You Typed
 

Recently uploaded

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 

Recently uploaded (20)

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 

AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit

  • 1. Introduction to Deep Learning with Cognitive Toolkit (CNTK) Marvin Heng Blog : http://hmheng.pinsland.com Twitter : @hmheng YouTube: http://bit.ly/hmheng_yt SlideShare: http://bit.ly/hmheng_ss Github: https://github.com/hmheng HMHENG. PINSLAND.COM Microsoft Cognitive Service Microsoft Cognitive ToolKit
  • 2. Who is Marvin? Software + Web Developer AI Enthusiast Blog : https://hmheng.pinsland.com Twitter : @hmheng YouTube: http://bit.ly/hmheng_yt SlideShare: http://bit.ly/hmheng_ss Github: https://github.com/hmheng Scan & Subscribe! hmheng.pinsland.com HMHENG. PINSLAND.COM
  • 4. Started from AI, ML then Deep Learning… HMHENG. PINSLAND.COM
  • 5. What is Deep Learning? A Subfield of Machine Learning Self Learning More complex than Machine Learning Neural Networks mimics the neural systems in our brains. HMHENG. PINSLAND.COM
  • 6. What is Deep Learning? HMHENG. PINSLAND.COM Credit: Nvidia
  • 7. What is Microsoft Cognitive ToolKit (CNTK)? HMHENG. PINSLAND.COM
  • 9. Microsoft Cognitive Toolkit (CNTK)? • Open-Source Development on GitHub (released 2.5 on 15th Mar 18) • Fast • Optimized for GPUs & Libraries • Best-in-Class multi-GPU/Multi-server algorithms • Flexible • BrainScript, C#/.NET, C++, Python, Network Definition Language, Model Editing Language(MEL) • Linux, Windows and Docker Container • Ease of Use & Wide-range of Support • FF-NN, CNN, RNN, LSTM, DSSM,… HMHENG. PINSLAND.COM
  • 10. Microsoft Cognitive Toolkit (CNTK) HMHENG. PINSLAND.COM Arbitrary Neural Networks Expression Composing simple building blocks into complex computational networks. Production Ready State-of-the-art accuracy Efficient Scalable to Multi-GPU/Multi- Server
  • 11. Microsoft Cognitive Toolkit HMHENG. PINSLAND.COM Design Number of layers, number of units Dependent on concept complexity Experimentation often required Activation Function Enables non- linear models Examples include sigmoid, hyperbolic tangent, ReLU, softmax, … Loss Function Measure the performance during training Examples include cross entropy Training Mechanism for getting optimal weights Overfitting Stop models from over-optimizing on training data set.
  • 12. Microsoft Cognitive Toolkit (CNTK) HMHENG. PINSLAND.COM Windows CPU|GPU NuGet – CPU | NuGet – GPU | NuGet – UWP CPU Linux CPU|GPU|Docker – CPU| Docker – GPU Requires OpenMPI MacOS Docker – CPU Cloud Data Science Virtual Machine | Azure Notebooks Azure Batch AI Training (CPU/GPU) | Project BrainWave (FPGA)
  • 13. Sharing Marvin Heng Blog : http://hmheng.pinsland.com Twitter : @hmheng YouTube: http://bit.ly/hmheng_yt SlideShare: http://bit.ly/hmheng_ss Github: https://github.com/hmheng Microsoft Cognitive Service HMHENG. PINSLAND.COM Microsoft Cognitive ToolKit
  • 14. What is Deep Learning HMHENG. PINSLAND.COM
  • 15. Open Neural Network Exchange HMHENG. PINSLAND.COM • An open format to represent deep learning models. • Collaboration between Microsoft, AWS and Facebook. • Supported by community of partners like Intel, ARM, AMD, nvidia, etc. • A share library with Caffe2, PyTorch, MXNet, Cognitive Toolkit. • Permissive MIT license and no patents.
  • 16. ONNX Aims HMHENG. PINSLAND.COM • Allow interoperability between frameworks • CNTK, Caffe2 and PyTorch • Allow hardware vendor to focus on one IR in their backend optimization • Allow training in one toolkit and deploy in another.
  • 17. ONNX Aims HMHENG. PINSLAND.COM • Allow interoperability between frameworks • CNTK, Caffe2 and PyTorch • Allow hardware vendor to focus on one IR in their backend optimization • Allow training in one toolkit and deploy in another.
  • 18. More… CTNK.ai Tutorial, Source Code, Example @ https://github.com/Microsoft/CNTK ONNX.ai HMHENG. PINSLAND.COM
  • 19. Marvin Heng Blog : http://hmheng.pinsland.com Twitter : @hmheng YouTube: http://bit.ly/hmheng_yt SlideShare: http://bit.ly/hmheng_ss Github: https://github.com/hmheng Thank You HMHENG. PINSLAND.COM
  • 20. Introduction to Deep Learning with Cognitive Toolkit (CNTK) Marvin Heng Blog : http://hmheng.pinsland.com Twitter : @hmheng YouTube: http://bit.ly/hmheng_yt SlideShare: http://bit.ly/hmheng_ss Github: https://github.com/hmheng HMHENG. PINSLAND.COM Microsoft Cognitive Service Microsoft Cognitive ToolKit