Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
PRESENTS
MICROSOFT GTSC, Bengaluru March 25, 2017
Powered by Brought to you by
Tulika Chaudharie & Harikharan Krishnaraju
...
Bringing it all
together
The Seeing AI Project
Computer Vision, Image, Speech Recognition,
NLP, and ML from Microsoft Cogn...
“The world and technology are
once again transforming.”
“We are Inspiring the Internet
Generation.”
Artificial Intelligenc...
Powered by Brought to you by
The future: Conversations
• Natural language between people
and technology
• Conversational c...
The problem
Understanding human-computer interaction is:
Technically
challenging
It’s exceedingly difficult to enable a
co...
Powered by Brought to you by
Microsoft
Cognitive
Services
Cognitive Services
28 purpose-built ML and AI services to add pr...
Powered by Brought to you by
Platform Services
Web
Apps
Mobile
Apps
API
Apps
Notification
Hubs
Hybrid
Cloud
Backup
StorSim...
Powered by Brought to you by
Our Approach –
AI Infrastructure & Services
Roll your own with REST APIs
Simple to add: just a few lines of
code required
Integrate into the language and
platform of ...
Powered by Brought to you by
Microsoft
Cognitive
Services
From faces to feelings, allow your
apps to understand images and...
Powered by Brought to you by
Language
Speech
Search
Machine
Learning
Knowledge Vision
Spell
check
Speech API
Entity linkin...
Computer Vision API
Distill actionable
information from
images
Video API
Analyze, edit, and
process videos within
your app...
Speech
Bing Speech API
Convert speech to text
and back again, and
understand its intent
Speaker Recognition API
Give your ...
Speech
Text Analytics
API
Detect sentiment,
key phrases,
topics,
and language
from your text
Bing Spell Check
API
Detect a...
Languag
e
Knowledg
e
Knowledge
Exploration Service
Add interactive search
over structured data to
your project
Entity Link...
Knowledg
e
Search
Bing Web
Search API
Connect powerful
search to your apps
Bing Video
Search API
Trending videos,
detailed...
SpeechVision Language SearchKnowledge
Powering products across Microsoft
Powered by Brought to you by
Computer Vision API
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
Computer Vision API
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
Powered by Brought to you by
Updated Computer Vision API
Content of Image:
Categories v0: [{ “name”: “animal”, “score”: 0....
Computer Vision – celebrity
detection
https://www.captionbot.ai
Emotion API
https://www.microsoft.com/cognitive-services/en-us/emotion-api
Powered by Brought to you by
1. Obtain API subscription key from microsoft.com/cognitive
2. Call REST endpoint, and pass A...
Protocols/Native
XML & EDI
Hybrid
Spectrum of
connectors
SaaS
• Azure Cognitive Face API
• Azure Cognitive LUIS
• Azure Co...
Start coding
microsoft.com/cognitive
Get started for free at
microsoft.com/Cognitive
Developer
Resources
Preview Pricing
https://www.microsoft.com/cognitive-services/en-us/pricing
Documentation
https://www.m...
Give your Logic Apps a human side using Cognitive Services
Give your Logic Apps a human side using Cognitive Services
Give your Logic Apps a human side using Cognitive Services
Give your Logic Apps a human side using Cognitive Services
Upcoming SlideShare
Loading in …5
×

Give your Logic Apps a human side using Cognitive Services

643 views

Published on

In this session, Microsoft Escalation Engineers Tulika Chaudharie & Harikharan Krishnaraju explain in detail on Artificial Intelligence and Machine Learning in Logic Apps using Cognitive Services.

Published in: Technology
  • Women usually act out of emotion, not logic. Take advantage of this and get your Ex back today! See how to ▲▲▲ http://ow.ly/f23I301xGAo
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Give your Logic Apps a human side using Cognitive Services

  1. 1. PRESENTS MICROSOFT GTSC, Bengaluru March 25, 2017 Powered by Brought to you by Tulika Chaudharie & Harikharan Krishnaraju Escalation Engineer, Microsoft GTSC Give your Apps a Human Side using Cognitive services
  2. 2. Bringing it all together The Seeing AI Project Computer Vision, Image, Speech Recognition, NLP, and ML from Microsoft Cognitive Services Watch Video HereRead Blog Here
  3. 3. “The world and technology are once again transforming.” “We are Inspiring the Internet Generation.” Artificial Intelligence & Machine Learning.
  4. 4. Powered by Brought to you by The future: Conversations • Natural language between people and technology • Conversational canvas • Bots and agents 2000s: Mobile • Social • User download apps from App Stores 1990s: Internet • Search • User “visits” websites 1980s: PC • Desktop
  5. 5. The problem Understanding human-computer interaction is: Technically challenging It’s exceedingly difficult to enable a computer to understand what a person wants and to find the pieces of information that are relevant to their intent. Costly to implement Building and maintaining machine learning systems requires a large investment of time, money and engineering resources Often domain specific In the past, building your own machine learned models often required assistance of a team of data scientists that would customize the models to the specific domain.
  6. 6. Powered by Brought to you by Microsoft Cognitive Services Cognitive Services 28 purpose-built ML and AI services to add predictable, configurable intelligence into any software • Parse natural language (LUIS) • Real-time transcription and translation services for voice • Vision and face detection algorithms • Sentence diagramming • Web language (hashtag) parsing • Many more
  7. 7. Powered by Brought to you by Platform Services Web Apps Mobile Apps API Apps Notification Hubs Hybrid Cloud Backup StorSimple Azure Site Recovery Import/Export SQL Database DocumentDB Redis Cache Azure Search Storage Tables SQL Data Warehouse Azure AD Health Monitoring AD Privileged Identity Management Operational Analytics Cloud Services Batch RemoteApp Service Fabric Visual Studio Application Insights VS Team Services Domain Services HDInsight Machine Learning Stream Analytics Data Factory Event Hubs Data Lake Analytics Service IoT Hub Data Catalog Security & Management Azure Active Directory Multi-Factor Authentication Automation Portal Key Vault Store/ Marketplace VM Image Gallery & VM Depot Azure AD B2C Scheduler Xamarin HockeyApp Power BI Embedded SQL Server Stretch Database Mobile Engagement Functions Cognitive Services Bot Framework Cortana Security Center Container Service VM Scale Sets Data Lake Store BizTalk Services Service Bus Logic Apps API Management Content Delivery Network Media Services Media Analytics
  8. 8. Powered by Brought to you by Our Approach – AI Infrastructure & Services
  9. 9. Roll your own with REST APIs Simple to add: just a few lines of code required Integrate into the language and platform of your choice Breadth of offerings helps you find the right API for your app Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support Easy Flexible Tested GET A KEY
  10. 10. Powered by Brought to you by Microsoft Cognitive Services From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
  11. 11. Powered by Brought to you by Language Speech Search Machine Learning Knowledge Vision Spell check Speech API Entity linking Recommendation API Bing autosuggest Computer vision Emotion Forecasting Text to speech Thumbnail generation Anomaly detection Custom recognition (CRIS) Bing image search Web language model Customer feedback analysis Academic knowledge OCR, tagging, captioning Sentiment scoring Bing news search Bing web search Text analytics Cognitive Services APIs
  12. 12. Computer Vision API Distill actionable information from images Video API Analyze, edit, and process videos within your app Face API Detect, identify, analyze, organize, and tag faces in photos Emotion API Personalize experiences with emotion recognition Vision Content Moderator Automated image, text, and video moderation
  13. 13. Speech Bing Speech API Convert speech to text and back again, and understand its intent Speaker Recognition API Give your app the ability to know who's talking Custom Recognition Intelligent Service Fine-tune speech recognition for anyone, anywhere
  14. 14. Speech Text Analytics API Detect sentiment, key phrases, topics, and language from your text Bing Spell Check API Detect and correct spelling mistakes within your app Web Language Model API Leverage the power of language models trained on web-scale data Linguistic Analysis API Easily parse complex text with language analysis Language Understanding Intelligent Service Teach your apps to understand commands from your users Languag e Translator Easily perform speech and text translation
  15. 15. Languag e Knowledg e Knowledge Exploration Service Add interactive search over structured data to your project Entity Linking Service Contextually extend knowledge of people, locations, and events Recommendations API Provide personalized product recommendations for your customers Academic Knowledge API Explore relationships among academic papers, journals, and authors QnA Maker Distill information into conversational, easy-to-navigate answers
  16. 16. Knowledg e Search Bing Web Search API Connect powerful search to your apps Bing Video Search API Trending videos, detailed metadata, and rich results Bing Autosuggest API Give your app intelligent autosuggest options for searches Bing Image Search API Bring advanced image and metadata search to your app Bing News Search API Link your users to robust and timely news searches
  17. 17. SpeechVision Language SearchKnowledge Powering products across Microsoft
  18. 18. Powered by Brought to you by
  19. 19. Computer Vision API https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
  20. 20. Computer Vision API https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
  21. 21. Powered by Brought to you by Updated Computer Vision API Content of Image: Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }] V1: [{ "name": "grass", "confidence": 0.9999992847442627 }, { "name": "outdoor", "confidence": 0.9999072551727295 }, { "name": "cow", "confidence": 0.99954754114151 }, { "name": "field", "confidence": 0.9976195693016052 }, { "name": "brown", "confidence": 0.988935649394989 }, { "name": "animal", "confidence": 0.97904372215271 }, { "name": "standing", "confidence": 0.9632768630981445 }, { "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" }, { "name": "wire", "confidence": 0.8946959376335144 }, { "name": "green", "confidence": 0.8844101428985596 }, { "name": "pasture", "confidence": 0.8332059383392334 }, { "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" }, { "name": "grassy", "confidence": 0.48627158999443054 }, { "name": "lush", "confidence": 0.1874018907546997 }, { "name": "staring", "confidence": 0.165890634059906 }] Describe 0.975 "a brown cow standing on top of a lush green field“ 0.974 “a cow standing on top of a lush green field” 0.965 “a large brown cow standing on top of a lush green field”
  22. 22. Computer Vision – celebrity detection https://www.captionbot.ai
  23. 23. Emotion API https://www.microsoft.com/cognitive-services/en-us/emotion-api
  24. 24. Powered by Brought to you by 1. Obtain API subscription key from microsoft.com/cognitive 2. Call REST endpoint, and pass API key via special header GET https://bingapis.azure-api.net/v5/search?q=nasa HTTP/1.1 OCP-Apim-Subscription-Key: <API KEY> Accessing the APIs
  25. 25. Protocols/Native XML & EDI Hybrid Spectrum of connectors SaaS • Azure Cognitive Face API • Azure Cognitive LUIS • Azure Cognitive Text Analytics • Azure Machine Learning
  26. 26. Start coding microsoft.com/cognitive
  27. 27. Get started for free at microsoft.com/Cognitive
  28. 28. Developer Resources Preview Pricing https://www.microsoft.com/cognitive-services/en-us/pricing Documentation https://www.microsoft.com/cognitive-services/en-us/computer-vision-api/documentation Client SDKs https://github.com/Microsoft/ProjectOxford-ClientSDK https://github.com/felixrieseberg/project-oxford (nodejs) https://github.com/southwood/project-oxford-python Example Code https://github.com/jsturtevant/happy-image-tester-django https://github.com/jsturtevant/happy-image-tester-nodejs Join Our Community https://stackoverflow.com/questions/tagged/microsoft-cognitive https://social.msdn.microsoft.com/forums/azure/en-US/home?forum=mlapi https://cognitive.uservoice.com/

×