Improving your vision with Azure Cognitive Services - /dev/070
•Download as PPTX, PDF•
1 like•434 views
Slides of the presentation I gave at the /dev/070 meetup on Dec 13th 2017. The repository with source code is located at: https://github.com/marcduiker/demos-azure-cognitive-services. In order to run execute the requests in the .http files you need VS Code with the Rest Client extension.
Recommended
Recommended
More Related Content
What's hot
What's hot (6)
Similar to Improving your vision with Azure Cognitive Services - /dev/070
Similar to Improving your vision with Azure Cognitive Services - /dev/070 (20)
More from Marc Duiker
More from Marc Duiker (7)
Recently uploaded
Recently uploaded (20)
Improving your vision with Azure Cognitive Services - /dev/070
- 1. Improving your vision with Azure Cognitive Services - MixUG 1 Improving your vision with Azure Cognitive Services 13 December – /dev/070
- 3. Agenda • What is Azure Cognitive Services • Computer Vision API • Azure Portal, VS Code & Visual Studio • Custom Vision API • Custom Vision portal Improving your vision with Azure Cognitive Services - /dev/070 3
- 4. ML & AI is hot! Improving your vision with Azure Cognitive Services - /dev/070 4
- 5. Improving your vision with Azure Cognitive Services - /dev/070 5
- 6. Improving your vision with Azure Cognitive Services - /dev/070 6
- 7. Cortana Intelligence Suite Improving your vision with Azure Cognitive Services - /dev/070 7
- 8. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs
- 9. Improving your vision with Azure Cognitive Services - /dev/070 9
- 10. Improving your vision with Azure Cognitive Services - /dev/070 10
- 11. Improving your vision with Azure Cognitive Services - /dev/070 11
- 12. Improving your vision with Azure Cognitive Services - /dev/070 12
- 13. Improving your vision with Azure Cognitive Services - /dev/070 13
- 14. Improving your vision with Azure Cognitive Services - /dev/070 14 Cognitive Services Labs https://labs.cognitive.microsoft.com/
- 15. Microsoft Cognitive Services Docs Improving your vision with Azure Cognitive Services - /dev/070 15
- 16. How did we end up here? Improving your vision with Azure Cognitive Services - /dev/070 16 Microsoft Cognitive Services Bing Search Project Oxford Microsoft CognitiveToolkit (CNTK) MicrosoftTechnology & Research 2015 2009 2016
- 17. Improving your vision with Azure Cognitive Services - MixUG 17 Computer Vision API
- 18. Computer Vision API • Recognize and understand information from images Improving your vision with Azure Cognitive Services - /dev/070 18 Tags Descriptions Faces Colors Domain models ImageType Cognitive Services Computer Vision API
- 19. Computer Vision API examples • API Reference • https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e c6739/operations/56f91f2e778daf14a499e1fa • Perform API calls from VS Code Improving your vision with Azure Cognitive Services - /dev/070 19
- 20. What do we need to get started? • Create Computer Vision API endpoint in Azure • Subscription key • Create an application to • Select an image • Do a post to the Computer Vision API endpoint Improving your vision with Azure Cognitive Services - /dev/070 20
- 21. Improving your vision with Azure Cognitive Services - MixUG 21
- 22. Demo: HelloCV • Provide a local image • Do a request to Analyze endpoint • Get analysis results back as json Improving your vision with Azure Cognitive Services - /dev/070 22 Tags Descriptions Faces Colors ImageTypeCognitive Services Computer Vision API
- 23. Demo: Analyze images on website Improving your vision with Azure Cognitive Services - /dev/070 23 http://... <img> <img> <img> File Scrape images Analyze Save results Cognitive Services uri uri uri Get sources Goal: Analyze images on a website
- 24. Cognitive Services Demo App • Computer Vision API • Analyze image • Describe image • OCR (optical character recognition) • Domain model detection: Landmarks • Emotion API • Emotion analysis Improving your vision with Azure Cognitive Services - /dev/070 24 https://github.com/marcduiker/demos-azure-cognitive-services
- 25. Improving your vision with Azure Cognitive Services - MixUG 25 Custom Vision API (preview)
- 26. Custom Vision API • Image classification Improving your vision with Azure Cognitive Services - /dev/070 26 Cognitive Services Custom Vision API Train #A #B ? #A
- 27. Custom Vision Demo Improving your vision with Azure Cognitive Services - /dev/070 27 Ferrari 250 GT SWB Aston Martin DB4
- 28. To sum it up • Ever growing collection of ‘intelligent’ APIs • Easy to get started • Choose carefully which API best suits your need • Think about confidence levels • When dealing with faces or handwriting: Personally identifiable information (PII) -> Privacy Improving your vision with Azure Cognitive Services - /dev/070 28
- 29. Improving your vision with Azure Cognitive Services - MixUG 29 Thanks! See you next time!
- 31. Cognitive Services Related Resources • https://azure.microsoft.com/en-us/services/cognitive-services/ • https://docs.microsoft.com/en-us/azure/cognitive-services/ • https://channel9.msdn.com/Search?term=Cognitive%20Services • https://www.microsoft.com/en-us/seeing-ai/ • https://www.microsoft.com/en-us/research/research-area/computer-vision/ • https://www.customvision.ai/ • https://github.com/marcduiker/demos-azure-cognitive-services Improving your vision with Azure Cognitive Services - /dev/070 31
Editor's Notes
- Logical progression after ‘big data’. https://www.forbes.com/sites/moorinsights/2017/01/06/five-things-to-watch-in-ai-and-machine-learning-in-2017/ https://blogs.sap.com/2017/01/30/machine-learning-will-be-2017s-top-trend-and-will-help-solve-iots-big-data-challenge/ https://www.ibm.com/blogs/think/2017/02/machine-learning/
- Azure Machine Learning: Create model Train model Score & test model Publish as a webservice
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
- No control over training the model. Black box.
- No control over training the model. Black box.
- Create Computer Vision Endpoint through: - Cognitive Services and select an API - Computer Vision API
- Perform demo with sites: www.nos.nl www.bbc.com/news http://designlike.com/100-most-famous-landmarks-around-the-world/
- You need to train the model yourself. There are categories: food,