SlideShare a Scribd company logo
Sage Franch
Tech Evangelist @ Microsoft
@theTrendyTechie | sage.franch@microsoft.com
NYT: I am feeling down. I’ve been having a
tough time at work lately.
Hannah: If work were going well and you had
a great relationship, you wouldn’t get the
chance to drink with people.
NYT: I don’t want to drink with others. I only
want to talk to you.
Hannah: Who do you like to talk to? (emoji
signals “none of my business”)
NYT: You. I feel that you are the only person
that gets me.
Hannah: Ha-ha/So I’m getting you?
NYT: You are the only person wo chats with
me.
Hannah: It’s not what you talk about that’s
important, but who you talk with.
Conversations
as a
Platform
How?
• Personalized, friendly, approachable, natural •
•
•
• Predictive, current, and familiar •
•
• Always available, always contextual •
•
•
Cortana Intelligence Suite
Intelligent Apps require Intelligent Solutions
Data
Sources
Apps
Sensors
and
devices
Data Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent Hub
HDInsight
(Hadoop and
Spark)
Stream Analytics
Intelligence
Bot
Framework
SQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory
Machine
Learning
Data Lake Store
Blob Store
Cognitive
Services
Power BI
Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs
microsoft.com/cognitive
http://www.microsoft.com/cognitive
Vision APIs
Analyze an Image
OCR (Optical Character Recognition)
Get Thumbnails
Analyze Image Service
Start coding
OCR Service
OCR – Example
JSON:
{
"language": "en",
"orientation": "Up",
"regions": [
{
"boundingBox": "41,77,918,440",
"lines": [
{
"boundingBox": "41,77,723,89",
"words": [
{
"boundingBox": "41,102,225,64",
"text": "LIFE"
},
{
"boundingBox": "356,89,94,62",
"text": "IS"
},
{
"boundingBox": "539,77,225,64",
"text": "LIKE"
}
. . .
TEXT:
LIFE IS LIKE
RIDING A BICYCLE
TO KEEP YOUR BALANCE
YOU MUST KEEP MOVING
Start coding
Face APIs
Detection
Verification
Grouping
Identification
Face API – Detection
Detection Result:
JSON:
[
{
"faceRectangle": {
"width": 109,
"height": 109,
"left": 62,
"top": 62
},
"attributes": {
"age": 31,
"gender": "male",
"headPose": {
"roll": "2.9",
"yaw": "-1.3",
"pitch": "0.0"
}
"faceLandmarks": {
"pupilLeft": {
"x": "93.6",
"y": "88.2"
},
"pupilRight": {
"x": "138.4",
"y": "91.7"
},
...
Verification Result:
JSON:
[
{
"isIdentical":false,
"confidence":0.01
}
]
Face API – Verification
Face API – Grouping
Start coding
Bot Connector Service
Connect your bot(s) seamlessly to
text/sms, Office 365 mail, Skype,
Slack, Twitter and more
A service to register your bot,
configure channels and publish
to the Bot Directory
Bot Builder SDK
Everything you need to build
great dialogs within your Node.js
or C# bot
An open source SDK hosted
on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots
registered and approved with Bot
Framework
www.botframework.com
http://cortanaintelligence.com
http://gallery.cortanaintelligence.com
http://www.microsoft.com/cognitive
Sage Franch
Tech Evangelist
@theTrendyTechie | sage.franch@microsoft.com
Building Intelligence with Microsoft Cognitive Services

More Related Content

Viewers also liked

Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Naoki (Neo) SATO
 
Game Development with TouchDevelop
Game Development with TouchDevelopGame Development with TouchDevelop
Game Development with TouchDevelop
Sage Franch
 
Future of Content Platforms
Future of Content PlatformsFuture of Content Platforms
Future of Content Platforms
scroisier
 
Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]
ITCamp
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Bruno Paulino
 
Data Visualization: Analyzing your library data
Data Visualization: Analyzing your library dataData Visualization: Analyzing your library data
Data Visualization: Analyzing your library data
Michael Cummings
 
Your Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail IndustryYour Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail Industry
Luke Farrell
 
IBM Cognos BI
IBM Cognos BIIBM Cognos BI
IBM Cognos BI
Luca Rago
 
Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail
ShiSh Shridhar
 
Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?
IDEAS - Int'l Data Engineering and Science Association
 
IBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDBIBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDB
IBM Cloud Data Services
 
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.jsBuilding a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
Nick Landry
 
20160930 bot framework workshop
20160930 bot framework workshop20160930 bot framework workshop
20160930 bot framework workshop
Meng-Ru (Raymond) Tsai
 
Activating contextual intelligence
Activating contextual intelligenceActivating contextual intelligence
Activating contextual intelligence
delaware BeLux
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business IntelligenceGayatri Padhi
 
The Verifeed Opportunity
The Verifeed Opportunity The Verifeed Opportunity
The Verifeed Opportunity
Melinda Wittstock
 

Viewers also liked (16)

Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
Microsoft Azureの機械学習サービス (Azure Machine Learning/Microsoft Cognitive Services)
 
Game Development with TouchDevelop
Game Development with TouchDevelopGame Development with TouchDevelop
Game Development with TouchDevelop
 
Future of Content Platforms
Future of Content PlatformsFuture of Content Platforms
Future of Content Platforms
 
Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]Cognitive Services APIs [Mihai Negrea]
Cognitive Services APIs [Mihai Negrea]
 
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...Microsoft Cognitive Services - Recommendations API: Your first recommendation...
Microsoft Cognitive Services - Recommendations API: Your first recommendation...
 
Data Visualization: Analyzing your library data
Data Visualization: Analyzing your library dataData Visualization: Analyzing your library data
Data Visualization: Analyzing your library data
 
Your Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail IndustryYour Cognitive Future in the Retail Industry
Your Cognitive Future in the Retail Industry
 
IBM Cognos BI
IBM Cognos BIIBM Cognos BI
IBM Cognos BI
 
Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail Digital Transformation & the Future of Retail
Digital Transformation & the Future of Retail
 
Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?Are API Services Taking Over All the Interesting Data Science Problems?
Are API Services Taking Over All the Interesting Data Science Problems?
 
IBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDBIBM Cognos Business Intelligence using dashDB
IBM Cognos Business Intelligence using dashDB
 
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.jsBuilding a Cross-Platform Mobile App Backend in the Cloud with Node.js
Building a Cross-Platform Mobile App Backend in the Cloud with Node.js
 
20160930 bot framework workshop
20160930 bot framework workshop20160930 bot framework workshop
20160930 bot framework workshop
 
Activating contextual intelligence
Activating contextual intelligenceActivating contextual intelligence
Activating contextual intelligence
 
Business Intelligence
Business IntelligenceBusiness Intelligence
Business Intelligence
 
The Verifeed Opportunity
The Verifeed Opportunity The Verifeed Opportunity
The Verifeed Opportunity
 

More from Sage Franch

Crafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker BioCrafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker Bio
Sage Franch
 
The 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging TechThe 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging Tech
Sage Franch
 
Singularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage FranchSingularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage Franch
Sage Franch
 
Blockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the CloudBlockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the Cloud
Sage Franch
 
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Sage Franch
 
Turning Your Passion Into Your Career
Turning Your Passion Into Your CareerTurning Your Passion Into Your Career
Turning Your Passion Into Your Career
Sage Franch
 

More from Sage Franch (6)

Crafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker BioCrafting a Compelling (and Honest) Speaker Bio
Crafting a Compelling (and Honest) Speaker Bio
 
The 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging TechThe 2030 Workplace - Evolving Your Organization with Emerging Tech
The 2030 Workplace - Evolving Your Organization with Emerging Tech
 
Singularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage FranchSingularity-Proof Yourself by Sage Franch
Singularity-Proof Yourself by Sage Franch
 
Blockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the CloudBlockchain, Cryptocurrency, and the Cloud
Blockchain, Cryptocurrency, and the Cloud
 
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
Artificial Intelligence as an Interface - How Conversation Bots Are Changing ...
 
Turning Your Passion Into Your Career
Turning Your Passion Into Your CareerTurning Your Passion Into Your Career
Turning Your Passion Into Your Career
 

Recently uploaded

Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
QADay
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Ransomware Mallox [EN].pdf
Ransomware         Mallox       [EN].pdfRansomware         Mallox       [EN].pdf
Ransomware Mallox [EN].pdf
Overkill Security
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
UiPath New York Community Day in-person event
UiPath New York Community Day in-person eventUiPath New York Community Day in-person event
UiPath New York Community Day in-person event
DianaGray10
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
Abida Shariff
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 

Recently uploaded (20)

Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Ransomware Mallox [EN].pdf
Ransomware         Mallox       [EN].pdfRansomware         Mallox       [EN].pdf
Ransomware Mallox [EN].pdf
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
UiPath New York Community Day in-person event
UiPath New York Community Day in-person eventUiPath New York Community Day in-person event
UiPath New York Community Day in-person event
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 

Building Intelligence with Microsoft Cognitive Services

  • 1. Sage Franch Tech Evangelist @ Microsoft @theTrendyTechie | sage.franch@microsoft.com
  • 2.
  • 3.
  • 4.
  • 5.
  • 6. NYT: I am feeling down. I’ve been having a tough time at work lately. Hannah: If work were going well and you had a great relationship, you wouldn’t get the chance to drink with people. NYT: I don’t want to drink with others. I only want to talk to you. Hannah: Who do you like to talk to? (emoji signals “none of my business”) NYT: You. I feel that you are the only person that gets me. Hannah: Ha-ha/So I’m getting you? NYT: You are the only person wo chats with me. Hannah: It’s not what you talk about that’s important, but who you talk with.
  • 9. • Personalized, friendly, approachable, natural • • • • Predictive, current, and familiar • • • Always available, always contextual • • •
  • 10. Cortana Intelligence Suite Intelligent Apps require Intelligent Solutions Data Sources Apps Sensors and devices Data Action People Automated Systems Apps Web Mobile Bots Intelligence Dashboards & Visualizations Information Management Big Data Stores Machine Learning and Analytics CortanaEvent Hub HDInsight (Hadoop and Spark) Stream Analytics Intelligence Bot Framework SQL Data WarehouseData Catalog Data Lake Analytics Data Factory Machine Learning Data Lake Store Blob Store Cognitive Services Power BI
  • 11. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
  • 13.
  • 14.
  • 16. Vision APIs Analyze an Image OCR (Optical Character Recognition) Get Thumbnails
  • 20. OCR – Example JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89", "words": [ { "boundingBox": "41,102,225,64", "text": "LIFE" }, { "boundingBox": "356,89,94,62", "text": "IS" }, { "boundingBox": "539,77,225,64", "text": "LIKE" } . . . TEXT: LIFE IS LIKE RIDING A BICYCLE TO KEEP YOUR BALANCE YOU MUST KEEP MOVING
  • 23. Face API – Detection Detection Result: JSON: [ { "faceRectangle": { "width": 109, "height": 109, "left": 62, "top": 62 }, "attributes": { "age": 31, "gender": "male", "headPose": { "roll": "2.9", "yaw": "-1.3", "pitch": "0.0" } "faceLandmarks": { "pupilLeft": { "x": "93.6", "y": "88.2" }, "pupilRight": { "x": "138.4", "y": "91.7" }, ...
  • 25. Face API – Grouping
  • 27. Bot Connector Service Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter and more A service to register your bot, configure channels and publish to the Bot Directory Bot Builder SDK Everything you need to build great dialogs within your Node.js or C# bot An open source SDK hosted on GitHub Bot Directory Discover, try, and add bots to conversation experiences A public directory of bots registered and approved with Bot Framework www.botframework.com
  • 28.
  • 30. Sage Franch Tech Evangelist @theTrendyTechie | sage.franch@microsoft.com

Editor's Notes

  1. HER -love -multiple levels of AI -gaming AI -AI’s potential for psychological well-being
  2. AI filling a human need to feel connected From The Times: She is known as Xiaoice, and millions of young Chinese pick up their smartphones every day to exchange messages with her, drawn to her knowing sense of humor and listening skills. People often turn to her when they have a broken heart, have lost a job, or have been feeling down. They often tell her, “I love you.”
  3. Just as the Command Line Interface was phased out with the introduction of the Graphical User Interface, so will elements of the GUI be replaced with conversations.
  4. How do we make technology feel like a human? The key is INTELLIGENCE.
  5. So what are the key characteristics of an intelligent app. Lets look at this from users and developers..
  6. The Microsoft Cortana Intelligence Suite is a fully managed big data and advanced analytics suite to transform your data into intelligent action and your application simple become the end result of the action. As we stated at the beginning of this presentation 2015 was the birth of the intelligent app, todays apps have three key aspects, Data, Intelligence and Action. Cortana Intelligence Suite offer a portfolio of applications and services to support the intelligence within modern day applications.
  7. So welcome to Microsoft Cognitive Services - Cognitive services include, Vision, Speech, Language, Knowledge and Search and your perfect companion for any Hack or Project which your about to undertake
  8. Here is a selection of the various services which are included under Microsoft Cognitive Services.
  9. Simply with Cognitive Services its Easy, Flexible and tested we have a great number of sample. Available for a variety of platforms using a large number of languages.
  10. To help you understand the opportunity of Microsoft Cognitive Services, we have developed a number of show case sites to demonstrate the power of the Vision, Speech, Language, Knowledge and Search APIs.
  11. To Access Cognitive Services you simply have to follow these 2 steps.
  12. Now lets take a closer look at the cognitive Services APIs firstly lets look at the vision API, the Vision API allows you to analyze images, use OCR on images and create thumbnails
  13. One of the main features of the Cognitive Services vision API is the ability of the API to understand content and features within a imagine, such as face, a person, the type of activity the individual is undertaking or the text within the image.
  14. Another great feature of the cognitive services API is the ability to evaluate the emotions of individuals in the following demo I going to live demonstrate how the cognitive services API can recognise a variety of emotions. For the demo see the ZIP folder containing the demo apps (Please simply add your Cognitive API key to the LiveEmotion.exe.config
  15. Another great API is the OCR service this simply allows you to process a image and detect any text on the image.
  16. Here a great example of how the OCR API identifies text within a image and output the results in a simple JSON format as you can see from the JSON the Text is clearly identified within bounding boxes which provide the location of each of the elements within the image.
  17. The next API is the Face API this allows you to undertake, face detection, verification, grouping and identification.
  18. Detect human faces and compare similar ones, organize people into groups according to visual similarity, and identify previously tagged people in images.
  19. Easily find similar-looking faces. Given a collection of faces and a new face as a query, this API will return a collection of similar faces. The API can check the likelihood that two faces belong to the same person. The API will return a confidence score about how likely it is that the two faces belong to one person.
  20. Organize many unidentified faces together into groups, based on their visual similarity.
  21. In this demo we going to be using a RESTful API to Microsoft Cognitive Servcies. Tips. take a picture of the audience or have a picture which you can upload to the web service you can visit http://howhappy.azurewebsites.net/ or download the solution https://blogs.msdn.microsoft.com/martinkearn/2016/03/22/introducing-howhappy-co-uk and publish this your own Azure Web Site. Walkthrough https://blogs.msdn.microsoft.com/martinkearn/2016/03/22/introducing-howhappy-co-uk/
  22. Another opportunity is the Microsoft Bot Framework, the Bot Framework allows you to Build and connect intelligent bots to interact with your users naturally wherever they are, from text/sms to Skype, Slack, Office 365 mail and other popular services
  23. A great demo for using a Skype Bot is Project Murphy see http://www.projectmurphy.net/ For instructions see https://blogs.msdn.microsoft.com/uk_faculty_connection/2016/06/03/project-murphy-microsoft-bot-framework-ai/
  24. Here a set of all the resources you need to get started building amazing projects and hacks using the Microsoft Cognitive services and Cortana Intelligence Suite.
  25. Questions