SlideShare a Scribd company logo
Azure Cognitive Services for
Developers
Marvin Heng, Microsoft MVP
www.techconnect.io | @hmheng
• Software Engineer | AI MVP
• Cognitive Services & Chatbot
• @hmheng
• www.techconnect.io
Marvin Heng
Microsoft Build 2019 marks an important
milestone for the evolution of Azure
Cognitive Services with the introduction of
new services and capabilities for developers.
Before update…..
After update…..
Decision Vision Speech Search Language
Content Moderator
Anomaly Detector
Computer Vision
Face
Video Indexer
Custom Vision
Speech Services Bing Web Search
Bing Visual Search
Bing Custom Search
Bing Entity Search
Bing Video Search
Bing News Search
Bing Image Search
Bing Autosuggest
Text Analytics
Translator Text
Bing Spell Check
QnA Maker
Content Moderator
Language
Understanding
Preview
Personalizer
Preview
Form Recognizer
Ink Recognizer
Updated
Speaker Recognition
Preview
Bing Local Business
Search
Preview
• Cognitive service APIs:
• Personalizer – creates personalized user experiences
• Conversation transcription – transcribes in-person meetings in real-time
• Form Recognizer – automates data-entry
• Ink Recognizer – unlocks the potential of digital inked content
General Available (GA)
• Neural Text-to-Speech
• Computer Vision Read
• Text Analytics Named Entity Recognition
Azure empowers developers to make
reinforcement learning real for businesses
with the launch of Personalizer.
Decision
Introducing Personalizer, reinforcement learning for the enterprise
Personalizer
• Provide information about your users and content and receive the
top action to show your users.
• No need to clean and label data before using Personalizer.
• Provide feedback to Personalizer when it is convenient to you.
• View real-time analytics.
• Use Personalizer as part of a larger data science effort to validate
existing experiments.
How does Personalizer work?
Where can I use Personalizer?
• Personalize what article is highlighted on a news website.
• Display a personalized "recommended item" on a shopping
website.
• Suggest user interface elements such as filters to apply to a specific
photo.
For Developers
• Send information (features) about your users and the content
(actions) to personalize. Personalizer responds with the top action.
• Send feedback to Personalizer about how well the ranking worked
as a number typically between 0 and 1.
Demo
Personalizer
Speech
In-person meetings just got better with conversation transcription
Conversation Transcription
• Updated Speech-to-text service
• Improves meeting efficiency by transcribing conversations in real-
time
• Integrates with a variety of meeting conference solutions including
Microsoft Teams and other third-party meeting software.
• SDK is available.
Conversation Transcription
• Updated Speech-to-text service
• Improves meeting efficiency by transcribing conversations in real-
time
• Help safeguard data with industry-leading security and compliance
certifications.
• Integrates with a variety of meeting conference solutions including
Microsoft Teams and other third-party meeting software.
• SDK is available.
Demo
Conversation Transcription
Vision
Unlocking the value of your content – from forms to digital inked
notes
Two new Vision APIs
• Form Recognizer
• Ink Recognizer
Form Recognizer
• Extract text and data from business’s forms and documents.
• Easily extract text and structure, with simple REST API
• Container support
Demo
Form Recognizer
Ink Recognizer
• Recognize digital handwriting, common shapes, and the layout of
inked documents.
• Create experiences that combine the benefits of physical pen and
paper with the best of the digital
Bringing AI to the Edge
Unlocking the value of your content – from forms to digital inked
notes
Container Support For Businesses AI Models
At The Edge
• Speech Services (Speech to Text & Text to Speech)
• Anomaly Detector
• Form Recognizer
General Available (GA)
More Improvements
Enhanced Cognitive Services for Developers
More Enhanced Cognitive Services
• Neural Text-to-Speech
• Supports 5 voices and 9 regions
• More voices available
• Changing voice & emotion by using Speech Synthesis Markup Language
<voice name='en-US-JessaNeural’>
<mstts:express-as type="cheerful">
• Computer Vision
• Multi-page documents
• Improve capabilities for extracting text from the most common file types.
• Now understands 10K+ concepts, scenes, and objects.
• Expanded the set of recognized celebrities from 200K to 1M
More Enhanced Cognitive Services
• Text Analytics
• Named entity recognition - takes free-form text and identifies the
occurrences of entities with 19 language supported.
• QnA Maker
• Supports multi-turn dialogs.
• Enhancing its core capability of extracting dialog from PDFs or websites.
Demo – Facial Search with Face Verification
A sample app empowered by Azure Cognitive Services
References
• Personalizer
• https://azure.microsoft.com/en-us/services/cognitive-services/personalizer/
• https://personalizationdemo.azurewebsites.net/
• Speech-To-Text
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/
• Form Recogizer
• https://azure.microsoft.com/en-us/services/cognitive-services/form-recognizer/
• Ink Recognizer
• https://azure.microsoft.com/en-us/services/cognitive-services/ink-recognizer/
• Speech
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/
• https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis-
markup
Azure Cognitive Services for
Developers
Marvin Heng, Microsoft MVP
www.techconnect.io | @hmheng

More Related Content

What's hot

Intro to Microsoft Cognitive Services
Intro to Microsoft Cognitive ServicesIntro to Microsoft Cognitive Services
Intro to Microsoft Cognitive Services
Amanda Lange
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
Usama Wahab Khan Cloud, Data and AI
 
An Introduction to Generative AI
An Introduction  to Generative AIAn Introduction  to Generative AI
An Introduction to Generative AI
Cori Faklaris
 
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
Naoki (Neo) SATO
 
Ibm watson
Ibm watsonIbm watson
Generative-AI-in-enterprise-20230615.pdf
Generative-AI-in-enterprise-20230615.pdfGenerative-AI-in-enterprise-20230615.pdf
Generative-AI-in-enterprise-20230615.pdf
Liming Zhu
 
Conversational AI and Chatbot Integrations
Conversational AI and Chatbot IntegrationsConversational AI and Chatbot Integrations
Conversational AI and Chatbot Integrations
Cristina Vidu
 
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdfai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
jason668539
 
Generative AI in Healthcare Market - Copy - Copy.pptx
Generative AI in Healthcare Market - Copy - Copy.pptxGenerative AI in Healthcare Market - Copy - Copy.pptx
Generative AI in Healthcare Market - Copy - Copy.pptx
GayatriGadhave1
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
Udaiappa Ramachandran
 
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdfIntro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Korkrid Akepanidtaworn
 
Generative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdfGenerative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdf
Priyanka Aash
 
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Paul Prae
 
The future of HR and talent in the age of generative AI.pdf
The future of HR and talent in the age of generative AI.pdfThe future of HR and talent in the age of generative AI.pdf
The future of HR and talent in the age of generative AI.pdf
Christian Palau
 
Generative AI.pptx
Generative AI.pptxGenerative AI.pptx
Generative AI.pptx
RohitRadhakrishnan8
 
Let's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchersLet's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchers
Steven Van Vaerenbergh
 
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Shrutika Oswal
 
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
DianaGray10
 
What is a chatbot?
What is a chatbot?What is a chatbot?
What is a chatbot?
Kamini Bharti
 
AI Chatbot
AI ChatbotAI Chatbot

What's hot (20)

Intro to Microsoft Cognitive Services
Intro to Microsoft Cognitive ServicesIntro to Microsoft Cognitive Services
Intro to Microsoft Cognitive Services
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
 
An Introduction to Generative AI
An Introduction  to Generative AIAn Introduction  to Generative AI
An Introduction to Generative AI
 
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
Microsoft Build 2023 Updates – Copilot Stack and Azure OpenAI Service (Machin...
 
Ibm watson
Ibm watsonIbm watson
Ibm watson
 
Generative-AI-in-enterprise-20230615.pdf
Generative-AI-in-enterprise-20230615.pdfGenerative-AI-in-enterprise-20230615.pdf
Generative-AI-in-enterprise-20230615.pdf
 
Conversational AI and Chatbot Integrations
Conversational AI and Chatbot IntegrationsConversational AI and Chatbot Integrations
Conversational AI and Chatbot Integrations
 
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdfai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
ai-powered-marketing-and-sales-reach-new-heights-with-generative-ai.pdf
 
Generative AI in Healthcare Market - Copy - Copy.pptx
Generative AI in Healthcare Market - Copy - Copy.pptxGenerative AI in Healthcare Market - Copy - Copy.pptx
Generative AI in Healthcare Market - Copy - Copy.pptx
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
 
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdfIntro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
 
Generative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdfGenerative AI and Security (1).pptx.pdf
Generative AI and Security (1).pptx.pdf
 
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
Azure as a Chatbot Service: From Purpose To Production With A Cloud Bot Archi...
 
The future of HR and talent in the age of generative AI.pdf
The future of HR and talent in the age of generative AI.pdfThe future of HR and talent in the age of generative AI.pdf
The future of HR and talent in the age of generative AI.pdf
 
Generative AI.pptx
Generative AI.pptxGenerative AI.pptx
Generative AI.pptx
 
Let's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchersLet's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchers
 
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
 
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
AI and ML Series - Leveraging Generative AI and LLMs Using the UiPath Platfor...
 
What is a chatbot?
What is a chatbot?What is a chatbot?
What is a chatbot?
 
AI Chatbot
AI ChatbotAI Chatbot
AI Chatbot
 

Similar to Azure Cognitive Services for Developers

A Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services IIA Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services II
Marvin Heng
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + Bots
HolzerKerstin
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft Azure
Marco Parenzan
 
Microsoft cognitive services
Microsoft cognitive servicesMicrosoft cognitive services
Microsoft cognitive services
Ali Zoljodi
 
Custom vision app step by step and cognitive service quick view
Custom vision app step by step and cognitive service quick viewCustom vision app step by step and cognitive service quick view
Custom vision app step by step and cognitive service quick view
R Ladies Taipei
 
Azure Weekend 2020 Build Malaysia Bus Uncle Chatbot
Azure Weekend 2020 Build Malaysia Bus Uncle ChatbotAzure Weekend 2020 Build Malaysia Bus Uncle Chatbot
Azure Weekend 2020 Build Malaysia Bus Uncle Chatbot
Cheah Eng Soon
 
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
Amazon Web Services
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
Amazon Web Services
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
Amazon Web Services
 
IBM Cloud Artificial Intelligence : A Comprehensive Overview
IBM Cloud Artificial Intelligence : A Comprehensive OverviewIBM Cloud Artificial Intelligence : A Comprehensive Overview
IBM Cloud Artificial Intelligence : A Comprehensive Overview
Satyajit Panda
 
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptxSG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
PriyankaShah668821
 
Evolve your app’s video experience with Azure: Processing and Video AI at scale
Evolve your app’s video experience with Azure: Processing and Video AI at scaleEvolve your app’s video experience with Azure: Processing and Video AI at scale
Evolve your app’s video experience with Azure: Processing and Video AI at scale
Microsoft Tech Community
 
Getting started with Azure Cognitive services
Getting started with Azure Cognitive servicesGetting started with Azure Cognitive services
Getting started with Azure Cognitive services
Rick van den Bosch
 
Cognitive IBM Watson Services for Bluemix Developers
Cognitive IBM Watson Services for Bluemix DevelopersCognitive IBM Watson Services for Bluemix Developers
Cognitive IBM Watson Services for Bluemix Developers
Niklas Heidloff
 
Conversational AI: What's New?
Conversational AI: What's New?Conversational AI: What's New?
Conversational AI: What's New?
Microsoft Tech Community
 
Language Studio and Custom Models
Language Studio and Custom ModelsLanguage Studio and Custom Models
Language Studio and Custom Models
Ivo Andreev
 
Intelligent ChatBot
Intelligent ChatBotIntelligent ChatBot
Intelligent ChatBot
antimo musone
 
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Sam Fernando
 
Designing XR Experiences with Speech & Natural Language Understanding in Unity
Designing XR Experiences with Speech & Natural Language Understandingin UnityDesigning XR Experiences with Speech & Natural Language Understandingin Unity
Designing XR Experiences with Speech & Natural Language Understanding in Unity
Nick Landry
 
Microsoft Teams Development - Conversational AI
Microsoft Teams Development - Conversational AIMicrosoft Teams Development - Conversational AI
Microsoft Teams Development - Conversational AI
Thomas Gölles
 

Similar to Azure Cognitive Services for Developers (20)

A Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services IIA Journey With Microsoft Cognitive Services II
A Journey With Microsoft Cognitive Services II
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + Bots
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft Azure
 
Microsoft cognitive services
Microsoft cognitive servicesMicrosoft cognitive services
Microsoft cognitive services
 
Custom vision app step by step and cognitive service quick view
Custom vision app step by step and cognitive service quick viewCustom vision app step by step and cognitive service quick view
Custom vision app step by step and cognitive service quick view
 
Azure Weekend 2020 Build Malaysia Bus Uncle Chatbot
Azure Weekend 2020 Build Malaysia Bus Uncle ChatbotAzure Weekend 2020 Build Malaysia Bus Uncle Chatbot
Azure Weekend 2020 Build Malaysia Bus Uncle Chatbot
 
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
 
IBM Cloud Artificial Intelligence : A Comprehensive Overview
IBM Cloud Artificial Intelligence : A Comprehensive OverviewIBM Cloud Artificial Intelligence : A Comprehensive Overview
IBM Cloud Artificial Intelligence : A Comprehensive Overview
 
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptxSG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
SG_UserGroup_Oct20_2022_NLP_AzureLangStudio.pptx
 
Evolve your app’s video experience with Azure: Processing and Video AI at scale
Evolve your app’s video experience with Azure: Processing and Video AI at scaleEvolve your app’s video experience with Azure: Processing and Video AI at scale
Evolve your app’s video experience with Azure: Processing and Video AI at scale
 
Getting started with Azure Cognitive services
Getting started with Azure Cognitive servicesGetting started with Azure Cognitive services
Getting started with Azure Cognitive services
 
Cognitive IBM Watson Services for Bluemix Developers
Cognitive IBM Watson Services for Bluemix DevelopersCognitive IBM Watson Services for Bluemix Developers
Cognitive IBM Watson Services for Bluemix Developers
 
Conversational AI: What's New?
Conversational AI: What's New?Conversational AI: What's New?
Conversational AI: What's New?
 
Language Studio and Custom Models
Language Studio and Custom ModelsLanguage Studio and Custom Models
Language Studio and Custom Models
 
Intelligent ChatBot
Intelligent ChatBotIntelligent ChatBot
Intelligent ChatBot
 
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
 
Designing XR Experiences with Speech & Natural Language Understanding in Unity
Designing XR Experiences with Speech & Natural Language Understandingin UnityDesigning XR Experiences with Speech & Natural Language Understandingin Unity
Designing XR Experiences with Speech & Natural Language Understanding in Unity
 
Microsoft Teams Development - Conversational AI
Microsoft Teams Development - Conversational AIMicrosoft Teams Development - Conversational AI
Microsoft Teams Development - Conversational AI
 

More from Marvin Heng

Accelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft CertificationsAccelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft Certifications
Marvin Heng
 
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Marvin Heng
 
Microsoft Cognitive Services at a Glance
Microsoft Cognitive Services at a GlanceMicrosoft Cognitive Services at a Glance
Microsoft Cognitive Services at a Glance
Marvin Heng
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extraction
Marvin Heng
 
A Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service IA Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service I
Marvin Heng
 
AI and App Accessibility
AI and App AccessibilityAI and App Accessibility
AI and App Accessibility
Marvin Heng
 
What's New With Azure AI
What's New With Azure AIWhat's New With Azure AI
What's New With Azure AI
Marvin Heng
 
Intelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFrameworkIntelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFramework
Marvin Heng
 
Using AI to solve business challenges
Using AI to solve business challengesUsing AI to solve business challenges
Using AI to solve business challenges
Marvin Heng
 
Intelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom VisionIntelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom Vision
Marvin Heng
 
Bot & AI - A Bot for Productivity
Bot & AI - A Bot for ProductivityBot & AI - A Bot for Productivity
Bot & AI - A Bot for Productivity
Marvin Heng
 
Artificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I SeeArtificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I See
Marvin Heng
 
Handwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive ServicesHandwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive Services
Marvin Heng
 
Create a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your CustomersCreate a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your Customers
Marvin Heng
 
Facial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET CoreFacial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET Core
Marvin Heng
 
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKitAI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
Marvin Heng
 
AI/ML/DL: Getting Started with Machine Learning on Azure
AI/ML/DL: Getting Started with Machine Learning on AzureAI/ML/DL: Getting Started with Machine Learning on Azure
AI/ML/DL: Getting Started with Machine Learning on Azure
Marvin Heng
 
AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.
Marvin Heng
 
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & AzureArtificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Marvin Heng
 
AI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You TypedAI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You Typed
Marvin Heng
 

More from Marvin Heng (20)

Accelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft CertificationsAccelerating Personal Development through Microsoft Certifications
Accelerating Personal Development through Microsoft Certifications
 
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022Microsoft BotFramework - Global AI Bootcamp Nepal 2022
Microsoft BotFramework - Global AI Bootcamp Nepal 2022
 
Microsoft Cognitive Services at a Glance
Microsoft Cognitive Services at a GlanceMicrosoft Cognitive Services at a Glance
Microsoft Cognitive Services at a Glance
 
Create real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extractionCreate real value in your business process by automated data and form extraction
Create real value in your business process by automated data and form extraction
 
A Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service IA Journey with Microsoft Cognitive Service I
A Journey with Microsoft Cognitive Service I
 
AI and App Accessibility
AI and App AccessibilityAI and App Accessibility
AI and App Accessibility
 
What's New With Azure AI
What's New With Azure AIWhat's New With Azure AI
What's New With Azure AI
 
Intelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFrameworkIntelligent Assistant with Microsoft BotFramework
Intelligent Assistant with Microsoft BotFramework
 
Using AI to solve business challenges
Using AI to solve business challengesUsing AI to solve business challenges
Using AI to solve business challenges
 
Intelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom VisionIntelligent Mobile App with Azure Custom Vision
Intelligent Mobile App with Azure Custom Vision
 
Bot & AI - A Bot for Productivity
Bot & AI - A Bot for ProductivityBot & AI - A Bot for Productivity
Bot & AI - A Bot for Productivity
 
Artificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I SeeArtificial Intelligence - Tell You What I See
Artificial Intelligence - Tell You What I See
 
Handwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive ServicesHandwriting Detection with Microsoft Cognitive Services
Handwriting Detection with Microsoft Cognitive Services
 
Create a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your CustomersCreate a Q&A Bot to Serve Your Customers
Create a Q&A Bot to Serve Your Customers
 
Facial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET CoreFacial Analysis with Angular Web App & ASP.NET Core
Facial Analysis with Angular Web App & ASP.NET Core
 
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKitAI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
AI/ML/DL: Introduction to Deep Learning with Cognitive ToolKit
 
AI/ML/DL: Getting Started with Machine Learning on Azure
AI/ML/DL: Getting Started with Machine Learning on AzureAI/ML/DL: Getting Started with Machine Learning on Azure
AI/ML/DL: Getting Started with Machine Learning on Azure
 
AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.AI: Integrate Search Function into Your App Using Bing Search API.
AI: Integrate Search Function into Your App Using Bing Search API.
 
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & AzureArtificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
Artificial Intelligent: Intelligent Bot With Microsoft Bot Framework & Azure
 
AI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You TypedAI: Mobile Apps That Understands Your Intention When You Typed
AI: Mobile Apps That Understands Your Intention When You Typed
 

Recently uploaded

When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 

Recently uploaded (20)

When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 

Azure Cognitive Services for Developers

  • 1. Azure Cognitive Services for Developers Marvin Heng, Microsoft MVP www.techconnect.io | @hmheng
  • 2. • Software Engineer | AI MVP • Cognitive Services & Chatbot • @hmheng • www.techconnect.io Marvin Heng
  • 3. Microsoft Build 2019 marks an important milestone for the evolution of Azure Cognitive Services with the introduction of new services and capabilities for developers.
  • 5. After update….. Decision Vision Speech Search Language Content Moderator Anomaly Detector Computer Vision Face Video Indexer Custom Vision Speech Services Bing Web Search Bing Visual Search Bing Custom Search Bing Entity Search Bing Video Search Bing News Search Bing Image Search Bing Autosuggest Text Analytics Translator Text Bing Spell Check QnA Maker Content Moderator Language Understanding Preview Personalizer Preview Form Recognizer Ink Recognizer Updated Speaker Recognition Preview Bing Local Business Search
  • 6. Preview • Cognitive service APIs: • Personalizer – creates personalized user experiences • Conversation transcription – transcribes in-person meetings in real-time • Form Recognizer – automates data-entry • Ink Recognizer – unlocks the potential of digital inked content
  • 7. General Available (GA) • Neural Text-to-Speech • Computer Vision Read • Text Analytics Named Entity Recognition
  • 8. Azure empowers developers to make reinforcement learning real for businesses with the launch of Personalizer.
  • 10. Personalizer • Provide information about your users and content and receive the top action to show your users. • No need to clean and label data before using Personalizer. • Provide feedback to Personalizer when it is convenient to you. • View real-time analytics. • Use Personalizer as part of a larger data science effort to validate existing experiments.
  • 11.
  • 13. Where can I use Personalizer? • Personalize what article is highlighted on a news website. • Display a personalized "recommended item" on a shopping website. • Suggest user interface elements such as filters to apply to a specific photo.
  • 14. For Developers • Send information (features) about your users and the content (actions) to personalize. Personalizer responds with the top action. • Send feedback to Personalizer about how well the ranking worked as a number typically between 0 and 1.
  • 16. Speech In-person meetings just got better with conversation transcription
  • 17. Conversation Transcription • Updated Speech-to-text service • Improves meeting efficiency by transcribing conversations in real- time • Integrates with a variety of meeting conference solutions including Microsoft Teams and other third-party meeting software. • SDK is available.
  • 18.
  • 19. Conversation Transcription • Updated Speech-to-text service • Improves meeting efficiency by transcribing conversations in real- time • Help safeguard data with industry-leading security and compliance certifications. • Integrates with a variety of meeting conference solutions including Microsoft Teams and other third-party meeting software. • SDK is available.
  • 21. Vision Unlocking the value of your content – from forms to digital inked notes
  • 22. Two new Vision APIs • Form Recognizer • Ink Recognizer
  • 23. Form Recognizer • Extract text and data from business’s forms and documents. • Easily extract text and structure, with simple REST API • Container support
  • 25. Ink Recognizer • Recognize digital handwriting, common shapes, and the layout of inked documents. • Create experiences that combine the benefits of physical pen and paper with the best of the digital
  • 26.
  • 27.
  • 28. Bringing AI to the Edge Unlocking the value of your content – from forms to digital inked notes
  • 29. Container Support For Businesses AI Models At The Edge • Speech Services (Speech to Text & Text to Speech) • Anomaly Detector • Form Recognizer
  • 31. More Improvements Enhanced Cognitive Services for Developers
  • 32. More Enhanced Cognitive Services • Neural Text-to-Speech • Supports 5 voices and 9 regions • More voices available • Changing voice & emotion by using Speech Synthesis Markup Language <voice name='en-US-JessaNeural’> <mstts:express-as type="cheerful"> • Computer Vision • Multi-page documents • Improve capabilities for extracting text from the most common file types. • Now understands 10K+ concepts, scenes, and objects. • Expanded the set of recognized celebrities from 200K to 1M
  • 33. More Enhanced Cognitive Services • Text Analytics • Named entity recognition - takes free-form text and identifies the occurrences of entities with 19 language supported. • QnA Maker • Supports multi-turn dialogs. • Enhancing its core capability of extracting dialog from PDFs or websites.
  • 34. Demo – Facial Search with Face Verification A sample app empowered by Azure Cognitive Services
  • 35. References • Personalizer • https://azure.microsoft.com/en-us/services/cognitive-services/personalizer/ • https://personalizationdemo.azurewebsites.net/ • Speech-To-Text • https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/ • Form Recogizer • https://azure.microsoft.com/en-us/services/cognitive-services/form-recognizer/ • Ink Recognizer • https://azure.microsoft.com/en-us/services/cognitive-services/ink-recognizer/ • Speech • https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/ • https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis- markup
  • 36. Azure Cognitive Services for Developers Marvin Heng, Microsoft MVP www.techconnect.io | @hmheng