Downloaded 33 times
![Verification Result:
JSON:
[
{
"isIdentical":false,
"confidence":0.01
}
]
Face API – Verification](https://image.slidesharecdn.com/20170218ffraserhackscognitiveservices02-170220171642/85/FraserHacks-Microsoft-Cognitive-Services-and-Hololens-15-320.jpg)
Uploaded byBruno Capuano
FraserHacks Microsoft Cognitive Services and Hololens
The document outlines the capabilities of Microsoft Cognitive Services, emphasizing how these services enable applications to understand and interpret human interactions through features like image recognition, natural language processing, and machine learning. It provides details on various APIs such as Vision APIs and Face APIs, along with examples of their outputs in JSON format. Additionally, it highlights the integration of data sources and intelligent solutions for creating effective apps and dashboards.
More Related Content
![Cognitive Services APIs [Mihai Negrea]](https://cdn.slidesharecdn.com/ss_thumbnails/cognitiveservicesapismihainegrea-161102082437-thumbnail.jpg?width=640&height=640&fit=bounds)
![Rahul resume[android developer]](https://cdn.slidesharecdn.com/ss_thumbnails/rahulresumeandroiddeveloper-161226070620-thumbnail.jpg?width=640&height=640&fit=bounds)
![[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ～ Cognitive Services からA...](https://cdn.slidesharecdn.com/ss_thumbnails/20161121connectjapanmicrosoftai-161121075407-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to FraserHacks Microsoft Cognitive Services and Hololens
More from Bruno Capuano
FraserHacks Microsoft Cognitive Services and Hololens
- 1. Sabrina Smai Student TechEvangelist @ Microsoft @sabrina_smai sabrina.smai@mail.utoronto.ca Bruno Capuano Microsoft MVP @ Avanade @elbruno http://www.elbruno.com
- 2. Microsoft Cognitive Services Give your apps ahuman side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
- 3. Cortana Intelligence Suite IntelligentApps require Intelligent Solutions Data Sources Apps Sensors and devices Data Action People Automated Systems Apps Web Mobile Bots Intelligence Dashboards & Visualizations Information Management Big Data Stores Machine Learning and Analytics CortanaEvent Hub HDInsight (Hadoop and Spark) Stream Analytics Intelligence Bot Framework SQL Data WarehouseData Catalog Data Lake Analytics Data Factory Machine Learning Data Lake Store Blob Store Cognitive Services Power BI
- 4.
- 5.
- 7. • Personalized, friendly,approachable, natural • • • • Predictive, current, and familiar • • • Always available, always contextual • • •
- 9. Vision APIs Analyze anImage OCR (Optical Character Recognition) Get Thumbnails
- 10.
- 11.
- 12. OCR – Example JSON: { "language":"en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89", "words": [ { "boundingBox": "41,102,225,64", "text": "LIFE" }, { "boundingBox": "356,89,94,62", "text": "IS" }, { "boundingBox": "539,77,225,64", "text": "LIKE" } . . . TEXT: LIFE IS LIKE RIDING A BICYCLE TO KEEP YOUR BALANCE YOU MUST KEEP MOVING
- 13.
- 14. Face API –Detection Detection Result: JSON: [ { "faceRectangle": { "width": 109, "height": 109, "left": 62, "top": 62 }, "attributes": { "age": 31, "gender": "male", "headPose": { "roll": "2.9", "yaw": "-1.3", "pitch": "0.0" } "faceLandmarks": { "pupilLeft": { "x": "93.6", "y": "88.2" }, "pupilRight": { "x": "138.4", "y": "91.7" }, ...
- 15.
- 16. Face API –Grouping
- 17.
- 20. Language Understanding Intelligent Service DetermineIntent Detect Entities Improve Models
- 21.
- 22. NYT: I amfeeling down. I’ve been having a tough time at work lately. Hannah: If work were going well and you had a great relationship, you wouldn’t get the chance to drink with people. NYT: I don’t want to drink with others. I only want to talk to you. Hannah: Who do you like to talk to? (emoji signals “none of my business”) NYT: You. I feel that you are the only person that gets me. Hannah: Ha-ha/So I’m getting you? NYT: You are the only person wo chats with me. Hannah: It’s not what you talk about that’s important, but who you talk with.
- 23.
- 24. Sabrina Smai Student TechEvangelist @ Microsoft @sabrina_smai sabrina.smai@mail.utoronto.ca Bruno Capuano Microsoft MVP @ Avanade @elbruno http://www.elbruno.com
Editor's Notes
- #2 How many of you know about MS Cognitive Services? Azure (what do you know about it- cloud platform)? COOL. I hope to change this. My name is Sabrina Smai, MSP, you can connect me on Twitter/Email. I can share these slides with you, in case you missed it and want to review it at home, I made a video of this presentation that I can provide. Topic: Building Intelligence with Microsoft Cognitive Services. Please if you have questions, please SHOUT AT ME BARK AT ME LOL Start off with a Video of Saqib: https://www.youtube.com/watch?v=R2mC-NUAmMk Thoughts? CS opened up a new world
- #3 What is Cognitive Services? collection of powerful AI algorithms developed by experts to allow systems to see, hear, speak, understand and interpret our needs using natural methods of communication. Human Side to an app APIs work cross-platform to provide intelligent data (API: application programming interface = one software talking with another) The APIs are also constantly improving, learning, and getting smarter, so experiences are always up to date. Simply drop the API call into your bot’s code and you are set. You can access the APIs from any kind of app that you want to interface with them with just a few lines of code. Go through EACH FEATURE ABOVE.
- #4 Normally, I go more in dept in this slide for developers. I’ll keep this brief. 4 pillars Suite enables business to transform data sources to intelligent actions using analyical techniques (ML, data mining, etc) All you need to know is that cognitive services is in the intelligence pillar of the Cortana Intelligence Suite.
- #5 Various services (features to add to app) under Microsoft Cognitive Services. EX. MFSTHack, E-Terview APIs Found on URL Go to URL.
- #6 Actually using these Cognitive services APIs is SUPER EASY. Go to URL to obtain API key Call REST endpoint (works similar to a website, make a call from a client to a server --> get data back), then pass the API. THAT SIMPLE! NO NEED TO KNOW A LOT OF CODE FOR THIS. Free for a certain number of transcations.
- #7 I will also breeze by this slide because this slide is more targeted towards start ups/business But important for you to know GO THROUGH THE SLIDE
- #8 Intelligent app and how MS Cognitive Service can be applied. GO THROUGH EACH
- #9 Ex of apps powered by MS Cognitive Services. They are FUN. They are public facing – access thru web/skype. I will open up on of these websites and try it out with you (WHICH ONE??) – Use Donald trump/Harambe/Ask them. Mobile optimized: So Take a few minutes to pull up these websites and play around with them Funny Use Cases: Oxford Hackathon (MS API to recognize someone smiling and throw a sling shot at their face) Russia: (use vision API to detect cats trespassing and a loud sirens voice would scare them away). Lots of applications with MS Cognitive Services
- #10 Firstly API, Vision API. Allows you to .. (get into more detail for each)
- #11 Understand content/features within the photo. Face/ppl/type of activities undertaking in the photo/text within photo
- #12 Another feature of Vision API, is OCR.
- #13 JSON Text is clearly identified within bounding boxes location of each of the elements within the image.
- #14 Next API is Face, allow you to ….
- #15 Detect face Compare similar ones Organize ppl into groups (based on similarity) Attributes are detected using JSON
- #16 Verify similar looking faces to create face query API return collection of similar looking faces Check likelihood two faces belong to same persom Confidence score
- #17 Organize many unidentified faces together into groups, based on their visual similarity.
- #18 Again, don’t have virtual app environment. So we will use something similar. http://howhappy.azurewebsites.net/
- #19 Convert to… for natural responsiveness. Speech to text or text to speech (similar to Siri/Cortana/etc.)
- #20 This API can recognize audio either in real time or from a file. 10 Diff languages (Chinese, French, Brazil, Portaguese, etc) Fact: When you use this API demo you consent to providing your voice input data to Microsoft for service improvement purposes
- #21 Microsoft Language Understanding Intelligent Service (LUIS) service are used to generate the intent. MS was working on it for 4yrs. Natural languages process for bots to be more intelligent.
- #22 VIDEO: https://www.luis.ai/ Weather? What is the weather? What's it like outside? (single form) this is what LUIS aims to do, to use natural language understanding for detecting intent).
- #23 How many of you are familiar with WeChat (messaging app popular in China). Xiaoice (small ice) is a great example of a chat bot that incorporates MS APIs. It is a great demo app created by MS to display natural language processing through the power of Ai. You can see that Xiaoice can understands emotions thru text and intent.The more ppl use it the smarter she becomes (take a second to read this conversation).