Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Give your Logic Apps a human side using Cognitive Services


Published on

In this session, Microsoft Escalation Engineers Tulika Chaudharie & Harikharan Krishnaraju explain in detail on Artificial Intelligence and Machine Learning in Logic Apps using Cognitive Services.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Give your Logic Apps a human side using Cognitive Services

  1. 1. PRESENTS MICROSOFT GTSC, Bengaluru March 25, 2017 Powered by Brought to you by Tulika Chaudharie & Harikharan Krishnaraju Escalation Engineer, Microsoft GTSC Give your Apps a Human Side using Cognitive services
  2. 2. Bringing it all together The Seeing AI Project Computer Vision, Image, Speech Recognition, NLP, and ML from Microsoft Cognitive Services Watch Video HereRead Blog Here
  3. 3. “The world and technology are once again transforming.” “We are Inspiring the Internet Generation.” Artificial Intelligence & Machine Learning.
  4. 4. Powered by Brought to you by The future: Conversations • Natural language between people and technology • Conversational canvas • Bots and agents 2000s: Mobile • Social • User download apps from App Stores 1990s: Internet • Search • User “visits” websites 1980s: PC • Desktop
  5. 5. The problem Understanding human-computer interaction is: Technically challenging It’s exceedingly difficult to enable a computer to understand what a person wants and to find the pieces of information that are relevant to their intent. Costly to implement Building and maintaining machine learning systems requires a large investment of time, money and engineering resources Often domain specific In the past, building your own machine learned models often required assistance of a team of data scientists that would customize the models to the specific domain.
  6. 6. Powered by Brought to you by Microsoft Cognitive Services Cognitive Services 28 purpose-built ML and AI services to add predictable, configurable intelligence into any software • Parse natural language (LUIS) • Real-time transcription and translation services for voice • Vision and face detection algorithms • Sentence diagramming • Web language (hashtag) parsing • Many more
  7. 7. Powered by Brought to you by Platform Services Web Apps Mobile Apps API Apps Notification Hubs Hybrid Cloud Backup StorSimple Azure Site Recovery Import/Export SQL Database DocumentDB Redis Cache Azure Search Storage Tables SQL Data Warehouse Azure AD Health Monitoring AD Privileged Identity Management Operational Analytics Cloud Services Batch RemoteApp Service Fabric Visual Studio Application Insights VS Team Services Domain Services HDInsight Machine Learning Stream Analytics Data Factory Event Hubs Data Lake Analytics Service IoT Hub Data Catalog Security & Management Azure Active Directory Multi-Factor Authentication Automation Portal Key Vault Store/ Marketplace VM Image Gallery & VM Depot Azure AD B2C Scheduler Xamarin HockeyApp Power BI Embedded SQL Server Stretch Database Mobile Engagement Functions Cognitive Services Bot Framework Cortana Security Center Container Service VM Scale Sets Data Lake Store BizTalk Services Service Bus Logic Apps API Management Content Delivery Network Media Services Media Analytics
  8. 8. Powered by Brought to you by Our Approach – AI Infrastructure & Services
  9. 9. Roll your own with REST APIs Simple to add: just a few lines of code required Integrate into the language and platform of your choice Breadth of offerings helps you find the right API for your app Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support Easy Flexible Tested GET A KEY
  10. 10. Powered by Brought to you by Microsoft Cognitive Services From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
  11. 11. Powered by Brought to you by Language Speech Search Machine Learning Knowledge Vision Spell check Speech API Entity linking Recommendation API Bing autosuggest Computer vision Emotion Forecasting Text to speech Thumbnail generation Anomaly detection Custom recognition (CRIS) Bing image search Web language model Customer feedback analysis Academic knowledge OCR, tagging, captioning Sentiment scoring Bing news search Bing web search Text analytics Cognitive Services APIs
  12. 12. Computer Vision API Distill actionable information from images Video API Analyze, edit, and process videos within your app Face API Detect, identify, analyze, organize, and tag faces in photos Emotion API Personalize experiences with emotion recognition Vision Content Moderator Automated image, text, and video moderation
  13. 13. Speech Bing Speech API Convert speech to text and back again, and understand its intent Speaker Recognition API Give your app the ability to know who's talking Custom Recognition Intelligent Service Fine-tune speech recognition for anyone, anywhere
  14. 14. Speech Text Analytics API Detect sentiment, key phrases, topics, and language from your text Bing Spell Check API Detect and correct spelling mistakes within your app Web Language Model API Leverage the power of language models trained on web-scale data Linguistic Analysis API Easily parse complex text with language analysis Language Understanding Intelligent Service Teach your apps to understand commands from your users Languag e Translator Easily perform speech and text translation
  15. 15. Languag e Knowledg e Knowledge Exploration Service Add interactive search over structured data to your project Entity Linking Service Contextually extend knowledge of people, locations, and events Recommendations API Provide personalized product recommendations for your customers Academic Knowledge API Explore relationships among academic papers, journals, and authors QnA Maker Distill information into conversational, easy-to-navigate answers
  16. 16. Knowledg e Search Bing Web Search API Connect powerful search to your apps Bing Video Search API Trending videos, detailed metadata, and rich results Bing Autosuggest API Give your app intelligent autosuggest options for searches Bing Image Search API Bring advanced image and metadata search to your app Bing News Search API Link your users to robust and timely news searches
  17. 17. SpeechVision Language SearchKnowledge Powering products across Microsoft
  18. 18. Powered by Brought to you by
  19. 19. Computer Vision API
  20. 20. Computer Vision API
  21. 21. Powered by Brought to you by Updated Computer Vision API Content of Image: Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }] V1: [{ "name": "grass", "confidence": 0.9999992847442627 }, { "name": "outdoor", "confidence": 0.9999072551727295 }, { "name": "cow", "confidence": 0.99954754114151 }, { "name": "field", "confidence": 0.9976195693016052 }, { "name": "brown", "confidence": 0.988935649394989 }, { "name": "animal", "confidence": 0.97904372215271 }, { "name": "standing", "confidence": 0.9632768630981445 }, { "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" }, { "name": "wire", "confidence": 0.8946959376335144 }, { "name": "green", "confidence": 0.8844101428985596 }, { "name": "pasture", "confidence": 0.8332059383392334 }, { "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" }, { "name": "grassy", "confidence": 0.48627158999443054 }, { "name": "lush", "confidence": 0.1874018907546997 }, { "name": "staring", "confidence": 0.165890634059906 }] Describe 0.975 "a brown cow standing on top of a lush green field“ 0.974 “a cow standing on top of a lush green field” 0.965 “a large brown cow standing on top of a lush green field”
  22. 22. Computer Vision – celebrity detection
  23. 23. Emotion API
  24. 24. Powered by Brought to you by 1. Obtain API subscription key from 2. Call REST endpoint, and pass API key via special header GET HTTP/1.1 OCP-Apim-Subscription-Key: <API KEY> Accessing the APIs
  25. 25. Protocols/Native XML & EDI Hybrid Spectrum of connectors SaaS • Azure Cognitive Face API • Azure Cognitive LUIS • Azure Cognitive Text Analytics • Azure Machine Learning
  26. 26. Start coding
  27. 27. Get started for free at
  28. 28. Developer Resources Preview Pricing Documentation Client SDKs (nodejs) Example Code Join Our Community