Accelerating Digital Transformation
with Microsoft Azure & Cognitive
Services
Thuan Nguyen
@nnthuan
A Bit About Me
• Speaker, Author and Evangelist,
and Advocate of Microsoft
technologies.
• 7 years Microsoft MVP
• Trying to help non-tech company
to become tech company
• On blog at thuansoldier.net
• Tweet at @nnthuan
• Communicate via thuan@s-15.xyz
(amzn.com/B07117YWFZ)
Your Home
I used to be addicted to social. Did you?
Your Country
Your Workplace
Your Shopping
Your Self-Service Flight
Your Vehicles
Digital Disruption Is Real
Largest accommodation
provider owns no real estate
Most popular media owner
creates no content
World’s largest taxi company
owns no taxi
World’s most valuable retailer
has no inventory
…and more
Every company is a software company
“Silicon Valley is
coming. We are going
to work hard to make
our services as
seamless and
competitive as theirs.”
Jamie Dimon
JP Morgan CEO
“Walmart is redefining
the next generation of
retail growth and is
the best-positioned
retailer to win at the
convergence of digital
and physical retail.”
Doug McMillon
Walmart CEO
“We are putting 70%
of our applications on
the cloud to improve
flexibility. And, we
are launching game-
changing applications
to improve our
efficiency.”
Jeffrey Immelt
GE CEO
“It's about looking
ahead to the changes
coming to the global
auto business,
particularly from
potential "disruptors"
in Silicon Valley—
and preparing Ford
to thrive through
those changes.”
Mark Fields
Ford Motor Company CEO
Main Focus Today
…still Business
Digital Transformation Platform
Digital Transformation Infrastructure
Business-Critical Application
…Business
Continuity
…New
Business
BusinessOwnerITOwner
Agility
Security
Cost
Availability
Integration
Key Driver
Relationship of Biz Owner & IT
Biz Owner’s thought
Cost Center
Upfront Capex
Business Privacy
Time wasting
Biz Misunderstanding
IT’s thought
High Demand
Dynamic Change
IT Misunderstanding
Cloud Computing to Enterprise
• A re-establishment of
connection between
Business & IT
• A reliable digital
transformation initiative
• Growth becomes unlimited
Cloud changes everything
Digital Transformation changes everything
Overview Slide
Up-to-date:
http://azureinteractives.azurewebsites.net
40Azure regions
Everywhere!
RECENTLY LAUNCHED:
US Gov: US Gov Texas and US Gov Arizona
NEWLY ANNOUNCED:
France: France Central and France South
Africa: South Africa North and South Africa West
The most trusted and compliance cloud
HIPAA /
HITECH Act
Moderate
JAB P-ATO
FIPS 140-2
FERPA
DoD DISA
SRG Level 2
ITAR CJIS
GxP
21 CFR Part 11
IRS 1075Section
508 VPAT
ISO 27001 SOC 1
Type 2
ISO 27018 CSA STAR
Self-Assessment
Singapore
MTCS
UK
G-Cloud
Australia
IRAP/CCSL
FISC
Japan
China
DJCP
New
Zealand
GCIO
China
GB 18030
EU
Model Clauses
ENISA
IAF
Argentina
PDPA
Japan CS
Mark Gold
SP 800-171
China
TRUCS
Spain
ENS
PCI DSS
Level 1
CDSA Shared
Assessments
MPAA
Japan
My
Number
Act
FACT
UK
High
JAB P-ATO
GLBA
DoD DISA
SRG Level 4
MARS-E FFIEC
ISO 27017 SOC 2
Type 2
SOC 3
India
MeitY
Canada
Privacy
Laws
Privacy
Shield
ISO 22301
Germany IT
Grundschutz
workbook
Spain
DPA
CSA STAR
Certification
CSA STAR
Attestation
HITRUST IG Toolkit
UK
GLOBALUSGOVINDUSTRYREGIONAL
Build and run open source solutions
Accelerating Digital Transformation
with Microsoft Azure & Cognitive
Services
Thuan Nguyen
@nnthuan
Azure
Cognitive
Services
Give your apps
a human side
What are Cognitive Services?
Cognitive services are a set of APIs that are designed to
democratize artificial intelligence by enabling systems to see, hear,
speak, understand and interpret our needs using natural methods
of communication.
What these services generally do is bring structured semantic data
to human knowledge I/O with a degree of confidence
“A picture of
Satya Nadella
happy”
This is about a
person
Image of
person
Emotional
readings
“x% sure that
this person is
[highest
emotion]”
REST/JSON-based Services
Azure Cognitive Services
Vision
Computer Vision API Distill actionable information from images
Content Moderator Automated image, text, and video moderation
Custom Vision Service Easily customize your own state-of-the-art
computer vision models for your unique use case
Face API Detect, identify, analyze, organize, and tag faces in
photos
Emotion API Personalize user experiences with emotion
recognition
Video Indexer Unlock video insights
Speech
Translator Speech API Easily conduct real-time speech translation with a
simple REST API call
Speaker Recognition API Use speech to identify and authenticate individual
speakers
Bing Speech API Convert speech to text and back again to
understand user intent
Custom Speech API Overcome speech recognition barriers like speaking
style, background noise, and vocabulary
Language
Language Understanding
Intelligent Service (LUIS)
Teach your apps to understand commands from
your users
Bing Spell Check API Detect and correct spelling mistakes in your app
Web Language Model API Use the power of predictive language models
trained on web-scale data
Text Analytics API Easily evaluate sentiment and topics to understand
what users want
Translator Text API Easily conduct machine translation with a simple
REST API call
Linguistic Analysis API Simplify complex language concepts and parse text
with the Linguistic Analysis API
Knowledge
Recommendations API Predict and recommend items your customers want
Knowledge Exploration Service Enable interactive search experiences over
structured data via natural language inputs
Entity Linking Intelligence
Service API
Power your app's data links with named entity
recognition and disambiguation
Academic Knowledge API Tap into the wealth of academic content in the
Microsoft Academic Graph
QnA Maker API Distill information into conversational, easy-to-
navigate answers
Custom Decision Service A cloud-based, contextual decision-making API that
sharpens with experience
Search
Bing Autosuggest API Give your app intelligent autosuggest options for
searches
Bing News Search API Search for news and get comprehensive results
Bing Web Search API Get enhanced search details from billions of web
documents
Bing Image Search API Search for images and get comprehensive results
Bing Video Search API Search for videos and get comprehensive results
Bing Custom Search API An easy-to-use, ad-free, commercial-grade search
tool that lets you deliver the results you want
Pricing
• Based on transaction volume
and data storage
• Free tier can be good for
evaluation with limits.
• Pricing model of each service
may vary
Tier Price
0 - 1,000,000 transactions $1 per 1,000 transactions
1,000,000 - 5,000,000
transactions
$0.75 per 1,000 transactions
5,000,000 - 10,000,000
transactions
$0.60 per 1,000 transactions
10,000,000 - 20,000,000
transactions
$0.40 per 1,000 transactions
Each API call is a transaction
Integrate with Cortana Intelligence Suite
Business Problem to be solved
How can I optimize the
productivity of my field
agents?
How can I predict the loads
on my energy grids so I can
balance?
How can I heat and cool
my buildings based on usage
and weather?
How can I fix equipment
proactively before it fails?
How can I stock my trucks
appropriately for the day
and week?
What demographic is my
most valuable?
What customer needs a
salesperson to call on them?
What product(s) is this
customer most likely to
buy next?
What fraudulent behavior
requires follow up?
Which payments need to
go to a human collector
to pursue?
What customers are likely
to leave and why?
What online customers
are most likely to visit
the dealership?
Who are my most valuable
customers and what are
they likely to buy?
What marketing or sales
motion leads to the most
revenue?
An example of SharePoint Transformation
• Transform your on-premises
to Azure IaaS.
• Build a remote Timer Job with
SharePoint Webhook and
Azure Functions
• Establish a Hybrid with Azure
Active Directory.
• Provider-hosted app with
Azure PaaS
Quick Test
• Register an Azure supscription
• Grab a key via
https://azure.microsoft.com/en-
us/try/cognitive-services/ or Azure
Portal.
• Insert API Key to your code
You can also call an API to return JSON or
directly test from Microsoft website.
Demostration – Text Analytics
• Create a Text Analytics service from Azure Portal
• Analyze key phrases and sentiment from custom feedback on Power BI
• Visualize it on dashboard
Sample Query on Power BI
= (text) => let
apikey = "ab76516554ac4616bd7b4830ceb8abcc",
endpoint = "https://southeastasia.api.cognitive.microsoft.com/text/analytics/v2.0/keyPhrases",
jsontext = Text.FromBinary(Json.FromValue(Text.Start(Text.Trim(text), 5000))),
jsonbody = "{ documents: [ { language: ""en"", id: ""0"", text: " & jsontext & " } ] }",
bytesbody = Text.ToBinary(jsonbody),
headers = [#"Ocp-Apim-Subscription-Key" = apikey],
bytesresp = Web.Contents(endpoint, [Headers=headers, Content=bytesbody]),
jsonresp = Json.Document(bytesresp),
keyphrases = Text.Lower(Text.Combine(jsonresp[documents]{0}[keyPhrases], ", "))
in keyphrases
= (text) => let
apikey = "ab76516554ac4616bd7b4830ceb8abcc",
endpoint = "https://southeastasia.api.cognitive.microsoft.com/text/analytics/v2.0/sentiment",
jsontext = Text.FromBinary(Json.FromValue(Text.Start(Text.Trim(text), 5000))),
jsonbody = "{ documents: [ { language: ""en"", id: ""0"", text: " & jsontext & " } ] }",
bytesbody = Text.ToBinary(jsonbody),
headers = [#"Ocp-Apim-Subscription-Key" = apikey],
bytesresp = Web.Contents(endpoint, [Headers=headers, Content=bytesbody]),
jsonresp = Json.Document(bytesresp),
sentiment = jsonresp[documents]{0}[score]
in sentiment
You only need one key at a time. Two keys are to support replacing a primary key
Visualization
Additional Resources
• Build a timer job with SharePoint Online & Azure Function -
https://docs.microsoft.com/en-
us/sharepoint/dev/apis/webhooks/sharepoint-webhooks-using-
azure-functions
• Explore more about Azure Cognitive Services -
https://docs.microsoft.com/en-us/azure/cognitive-services/
• Sample Intelligent Kiosk for Cognitive Services evaluation -
https://github.com/Microsoft/Cognitive-Samples-IntelligentKiosk
• Azure Cognitive Services Code Sample -
https://azure.microsoft.com/en-
us/resources/samples/?service=cognitive-services&sort=0

VJCD2017 Accelerating digital transformation with azure and cognitive services

  • 1.
    Accelerating Digital Transformation withMicrosoft Azure & Cognitive Services Thuan Nguyen @nnthuan
  • 2.
    A Bit AboutMe • Speaker, Author and Evangelist, and Advocate of Microsoft technologies. • 7 years Microsoft MVP • Trying to help non-tech company to become tech company • On blog at thuansoldier.net • Tweet at @nnthuan • Communicate via thuan@s-15.xyz (amzn.com/B07117YWFZ)
  • 3.
  • 4.
    I used tobe addicted to social. Did you?
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
    Digital Disruption IsReal Largest accommodation provider owns no real estate Most popular media owner creates no content World’s largest taxi company owns no taxi World’s most valuable retailer has no inventory …and more
  • 11.
    Every company isa software company “Silicon Valley is coming. We are going to work hard to make our services as seamless and competitive as theirs.” Jamie Dimon JP Morgan CEO “Walmart is redefining the next generation of retail growth and is the best-positioned retailer to win at the convergence of digital and physical retail.” Doug McMillon Walmart CEO “We are putting 70% of our applications on the cloud to improve flexibility. And, we are launching game- changing applications to improve our efficiency.” Jeffrey Immelt GE CEO “It's about looking ahead to the changes coming to the global auto business, particularly from potential "disruptors" in Silicon Valley— and preparing Ford to thrive through those changes.” Mark Fields Ford Motor Company CEO
  • 12.
    Main Focus Today …stillBusiness Digital Transformation Platform Digital Transformation Infrastructure Business-Critical Application …Business Continuity …New Business BusinessOwnerITOwner Agility Security Cost Availability Integration Key Driver
  • 13.
    Relationship of BizOwner & IT Biz Owner’s thought Cost Center Upfront Capex Business Privacy Time wasting Biz Misunderstanding IT’s thought High Demand Dynamic Change IT Misunderstanding
  • 14.
    Cloud Computing toEnterprise • A re-establishment of connection between Business & IT • A reliable digital transformation initiative • Growth becomes unlimited
  • 15.
    Cloud changes everything DigitalTransformation changes everything
  • 16.
  • 17.
    40Azure regions Everywhere! RECENTLY LAUNCHED: USGov: US Gov Texas and US Gov Arizona NEWLY ANNOUNCED: France: France Central and France South Africa: South Africa North and South Africa West
  • 18.
    The most trustedand compliance cloud HIPAA / HITECH Act Moderate JAB P-ATO FIPS 140-2 FERPA DoD DISA SRG Level 2 ITAR CJIS GxP 21 CFR Part 11 IRS 1075Section 508 VPAT ISO 27001 SOC 1 Type 2 ISO 27018 CSA STAR Self-Assessment Singapore MTCS UK G-Cloud Australia IRAP/CCSL FISC Japan China DJCP New Zealand GCIO China GB 18030 EU Model Clauses ENISA IAF Argentina PDPA Japan CS Mark Gold SP 800-171 China TRUCS Spain ENS PCI DSS Level 1 CDSA Shared Assessments MPAA Japan My Number Act FACT UK High JAB P-ATO GLBA DoD DISA SRG Level 4 MARS-E FFIEC ISO 27017 SOC 2 Type 2 SOC 3 India MeitY Canada Privacy Laws Privacy Shield ISO 22301 Germany IT Grundschutz workbook Spain DPA CSA STAR Certification CSA STAR Attestation HITRUST IG Toolkit UK GLOBALUSGOVINDUSTRYREGIONAL
  • 19.
    Build and runopen source solutions
  • 20.
    Accelerating Digital Transformation withMicrosoft Azure & Cognitive Services Thuan Nguyen @nnthuan Azure Cognitive Services Give your apps a human side
  • 21.
    What are CognitiveServices? Cognitive services are a set of APIs that are designed to democratize artificial intelligence by enabling systems to see, hear, speak, understand and interpret our needs using natural methods of communication. What these services generally do is bring structured semantic data to human knowledge I/O with a degree of confidence “A picture of Satya Nadella happy” This is about a person Image of person Emotional readings “x% sure that this person is [highest emotion]”
  • 22.
  • 23.
  • 24.
    Vision Computer Vision APIDistill actionable information from images Content Moderator Automated image, text, and video moderation Custom Vision Service Easily customize your own state-of-the-art computer vision models for your unique use case Face API Detect, identify, analyze, organize, and tag faces in photos Emotion API Personalize user experiences with emotion recognition Video Indexer Unlock video insights
  • 25.
    Speech Translator Speech APIEasily conduct real-time speech translation with a simple REST API call Speaker Recognition API Use speech to identify and authenticate individual speakers Bing Speech API Convert speech to text and back again to understand user intent Custom Speech API Overcome speech recognition barriers like speaking style, background noise, and vocabulary
  • 26.
    Language Language Understanding Intelligent Service(LUIS) Teach your apps to understand commands from your users Bing Spell Check API Detect and correct spelling mistakes in your app Web Language Model API Use the power of predictive language models trained on web-scale data Text Analytics API Easily evaluate sentiment and topics to understand what users want Translator Text API Easily conduct machine translation with a simple REST API call Linguistic Analysis API Simplify complex language concepts and parse text with the Linguistic Analysis API
  • 27.
    Knowledge Recommendations API Predictand recommend items your customers want Knowledge Exploration Service Enable interactive search experiences over structured data via natural language inputs Entity Linking Intelligence Service API Power your app's data links with named entity recognition and disambiguation Academic Knowledge API Tap into the wealth of academic content in the Microsoft Academic Graph QnA Maker API Distill information into conversational, easy-to- navigate answers Custom Decision Service A cloud-based, contextual decision-making API that sharpens with experience
  • 28.
    Search Bing Autosuggest APIGive your app intelligent autosuggest options for searches Bing News Search API Search for news and get comprehensive results Bing Web Search API Get enhanced search details from billions of web documents Bing Image Search API Search for images and get comprehensive results Bing Video Search API Search for videos and get comprehensive results Bing Custom Search API An easy-to-use, ad-free, commercial-grade search tool that lets you deliver the results you want
  • 29.
    Pricing • Based ontransaction volume and data storage • Free tier can be good for evaluation with limits. • Pricing model of each service may vary Tier Price 0 - 1,000,000 transactions $1 per 1,000 transactions 1,000,000 - 5,000,000 transactions $0.75 per 1,000 transactions 5,000,000 - 10,000,000 transactions $0.60 per 1,000 transactions 10,000,000 - 20,000,000 transactions $0.40 per 1,000 transactions Each API call is a transaction
  • 30.
    Integrate with CortanaIntelligence Suite
  • 31.
    Business Problem tobe solved How can I optimize the productivity of my field agents? How can I predict the loads on my energy grids so I can balance? How can I heat and cool my buildings based on usage and weather? How can I fix equipment proactively before it fails? How can I stock my trucks appropriately for the day and week? What demographic is my most valuable? What customer needs a salesperson to call on them? What product(s) is this customer most likely to buy next? What fraudulent behavior requires follow up? Which payments need to go to a human collector to pursue? What customers are likely to leave and why? What online customers are most likely to visit the dealership? Who are my most valuable customers and what are they likely to buy? What marketing or sales motion leads to the most revenue?
  • 32.
    An example ofSharePoint Transformation • Transform your on-premises to Azure IaaS. • Build a remote Timer Job with SharePoint Webhook and Azure Functions • Establish a Hybrid with Azure Active Directory. • Provider-hosted app with Azure PaaS
  • 33.
    Quick Test • Registeran Azure supscription • Grab a key via https://azure.microsoft.com/en- us/try/cognitive-services/ or Azure Portal. • Insert API Key to your code You can also call an API to return JSON or directly test from Microsoft website.
  • 34.
    Demostration – TextAnalytics • Create a Text Analytics service from Azure Portal • Analyze key phrases and sentiment from custom feedback on Power BI • Visualize it on dashboard
  • 35.
    Sample Query onPower BI = (text) => let apikey = "ab76516554ac4616bd7b4830ceb8abcc", endpoint = "https://southeastasia.api.cognitive.microsoft.com/text/analytics/v2.0/keyPhrases", jsontext = Text.FromBinary(Json.FromValue(Text.Start(Text.Trim(text), 5000))), jsonbody = "{ documents: [ { language: ""en"", id: ""0"", text: " & jsontext & " } ] }", bytesbody = Text.ToBinary(jsonbody), headers = [#"Ocp-Apim-Subscription-Key" = apikey], bytesresp = Web.Contents(endpoint, [Headers=headers, Content=bytesbody]), jsonresp = Json.Document(bytesresp), keyphrases = Text.Lower(Text.Combine(jsonresp[documents]{0}[keyPhrases], ", ")) in keyphrases = (text) => let apikey = "ab76516554ac4616bd7b4830ceb8abcc", endpoint = "https://southeastasia.api.cognitive.microsoft.com/text/analytics/v2.0/sentiment", jsontext = Text.FromBinary(Json.FromValue(Text.Start(Text.Trim(text), 5000))), jsonbody = "{ documents: [ { language: ""en"", id: ""0"", text: " & jsontext & " } ] }", bytesbody = Text.ToBinary(jsonbody), headers = [#"Ocp-Apim-Subscription-Key" = apikey], bytesresp = Web.Contents(endpoint, [Headers=headers, Content=bytesbody]), jsonresp = Json.Document(bytesresp), sentiment = jsonresp[documents]{0}[score] in sentiment You only need one key at a time. Two keys are to support replacing a primary key
  • 36.
  • 37.
    Additional Resources • Builda timer job with SharePoint Online & Azure Function - https://docs.microsoft.com/en- us/sharepoint/dev/apis/webhooks/sharepoint-webhooks-using- azure-functions • Explore more about Azure Cognitive Services - https://docs.microsoft.com/en-us/azure/cognitive-services/ • Sample Intelligent Kiosk for Cognitive Services evaluation - https://github.com/Microsoft/Cognitive-Samples-IntelligentKiosk • Azure Cognitive Services Code Sample - https://azure.microsoft.com/en- us/resources/samples/?service=cognitive-services&sort=0

Editor's Notes

  • #22 https://aka.ms/trysentiment