Improving your vision with Azure Cognitive Services - /dev/070

•Download as PPTX, PDF•

1 like•434 views

Slides of the presentation I gave at the /dev/070 meetup on Dec 13th 2017. The repository with source code is located at: https://github.com/marcduiker/demos-azure-cognitive-services. In order to run execute the requests in the .http files you need VS Code with the Rest Client extension.

Improving your vision with Azure Cognitive Services - MixUG 1
Improving your vision with Azure Cognitive Services
13 December – /dev/070

About me:
Marc Duiker
mduiker@xpirit.comwww.xpirit.com
blog.marcduiker.nl
@marcduiker
‘13-’16
www.youtube.com/user/marcduiker

Agenda
• What is Azure Cognitive Services
• Computer Vision API
• Azure Portal, VS Code & Visual Studio
• Custom Vision API
• Custom Vision portal
Improving your vision with Azure Cognitive Services - /dev/070 3

ML & AI is hot!
Improving your vision with Azure Cognitive Services - /dev/070 4

Improving your vision with Azure Cognitive Services - /dev/070 5

Improving your vision with Azure Cognitive Services - /dev/070 6

Cortana Intelligence Suite
Improving your vision with Azure Cognitive Services - /dev/070 7

Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs

Improving your vision with Azure Cognitive Services - /dev/070 9

Improving your vision with Azure Cognitive Services - /dev/070 10

Improving your vision with Azure Cognitive Services - /dev/070 11

Improving your vision with Azure Cognitive Services - /dev/070 12

Improving your vision with Azure Cognitive Services - /dev/070 13

Improving your vision with Azure Cognitive Services - /dev/070 14
Cognitive Services Labs
https://labs.cognitive.microsoft.com/

Microsoft Cognitive Services Docs
Improving your vision with Azure Cognitive Services - /dev/070 15

How did we end up here?
Improving your vision with Azure Cognitive Services - /dev/070 16
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft CognitiveToolkit
(CNTK)
MicrosoftTechnology & Research
2015
2009 2016

Improving your vision with Azure Cognitive Services - MixUG 17
Computer Vision API

Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - /dev/070 18
Tags
Descriptions
Faces
Colors
Domain models
ImageType
Cognitive Services
Computer Vision API

Computer Vision API examples
• API Reference
• https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e
c6739/operations/56f91f2e778daf14a499e1fa
• Perform API calls from VS Code
Improving your vision with Azure Cognitive Services - /dev/070 19

What do we need to get started?
• Create Computer Vision API endpoint in Azure
• Subscription key
• Create an application to
• Select an image
• Do a post to the Computer Vision API endpoint
Improving your vision with Azure Cognitive Services - /dev/070 20

Improving your vision with Azure Cognitive Services - MixUG 21

Demo: HelloCV
• Provide a local image
• Do a request to Analyze endpoint
• Get analysis results back as json
Improving your vision with Azure Cognitive Services - /dev/070 22
Tags
Descriptions
Faces
Colors
ImageTypeCognitive Services
Computer Vision API

Demo: Analyze images on website
Improving your vision with Azure Cognitive Services - /dev/070 23
http://...
<img>
<img>
<img>
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website

Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - /dev/070 24
https://github.com/marcduiker/demos-azure-cognitive-services

Improving your vision with Azure Cognitive Services - MixUG 25
Custom Vision API (preview)

Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - /dev/070 26
Cognitive Services
Custom Vision API
Train
#A #B
? #A

Custom Vision Demo
Improving your vision with Azure Cognitive Services - /dev/070 27
Ferrari 250 GT SWB Aston Martin DB4

To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - /dev/070 28

Improving your vision with Azure Cognitive Services - MixUG 29
Thanks! See you next time!

Marc Duiker
mduiker@xpirit.com
@marcduiker
Xpirit
Laapersveld 27
Hilversum
www.xpirit.com

Cognitive Services Related Resources
• https://azure.microsoft.com/en-us/services/cognitive-services/
• https://docs.microsoft.com/en-us/azure/cognitive-services/
• https://channel9.msdn.com/Search?term=Cognitive%20Services
• https://www.microsoft.com/en-us/seeing-ai/
• https://www.microsoft.com/en-us/research/research-area/computer-vision/
• https://www.customvision.ai/
• https://github.com/marcduiker/demos-azure-cognitive-services
Improving your vision with Azure Cognitive Services - /dev/070 31

Azure Custom Vision allows you to create powerful image classifiers in minutes to without having to be an AI expert. You feed the service with images -so the service adapts to your own needs-, tag them and train a model that can be published to an endpoint URL for further requests. You can also use the Custom Vision SDK to automatize the process. Furthermore, this model can also be exported for offline, real-time classification experiences. For instance, you can embed the classifier into a mobile application, or a website. In this session, the Custom Vision service will be described. An image classifier will be created by using the .portal. The output model will be exported to both Tensorflow and CoreML to integrate it into an Android and iOS mobile applications, respectively.

Create real value in your business process by automated data and form extraction

Marvin Heng

SQLDay 2021 PL AI Enrichment Azure Search.pptx

Luis Beltran

Global Azure2021 Verona.pptx

Luis Beltran

Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...

Windows Developer

The web platform is more powerful than ever, and we’re on the cusp of a revolution in what web sites and web apps are capable of. In this session, we take a quick tour of what’s new in Microsoft Edge and the Windows web platform, and then chart our course for the year ahead: New capabilities that make next-generation web experiences virtually indistinguishable from native apps, and new features and improvements that will raise the bar for what a browser can do.

Improving your vision with Azure Cognitive Services - MixUG

Marc Duiker

Biometric Systems - Automate Video Streaming Analysis with Azure and AWS

Roberto Falconi

Computer Vision and Text Analytics Using Azure Cognitive Services

Umme Rubaiyat Chowdhury

Azure Cognitive Services로 똑똑한 서비스 만들

Hong Min Kim

Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

Pablo Farías Navarro

With recent innovations in technology, AI has left the realms of science fiction and is becoming increasingly mainstream. Whether you’re interested in building games or apps, a sound understanding of the practical applications of AI will give you the edge needed to stand out from the crowd and will set you up for success. Through this workshop, you’ll gain hands-on experience in adding AI elements into games and apps built with Unity. Using Microsoft Cognitive Services, a cloud-based AI platform, you’ll get exposure to AI features including computer vision and language recognition. Assets and starting files will be provided for you to work with during the practical components of this 2-hour workshop. This workshop will be taught by Pablo Farias Navarro, founder of Zenva - a leading education platform to learn coding and game making. Since 2012, Pablo has been developing professional-grade courses that have helped over 1 million learners worldwide.

Getting started with microsoft cognitive services api

Jasjit Chopra

Creating applications that can see, hear, speak or understand using microso...

Radu Vunvulea

In this workshop, you will be introduced to the Microsoft Azure Cognitive Services, a range of offerings you can use to infuse intelligence and machine learning into your applications without needing to build the code from scratch. We will cover pre-trained AI APIs, such as computer vision and text analytics, that is accessed by REST protocol. Next, we will dive into Custom AI that uses transfer learning - Microsoft Azure Custom Vision. This enables you to provide a small amount of your own data to train an image classification model. Wrapping the workshop up by building our custom trained AI into an application - using Logic Apps, this technology is ideal for building data pipeline processes that work with your machine learning models.Title: Creating applications that can see, hear, speak or understand - using Microsoft Cognitive Services Workshop Description: In this workshop, you will be introduced to the Microsoft Azure Cognitive Services, a range of offerings you can use to infuse intelligence and machine learning into your applications without needing to build the code from scratch. We will cover pre-trained AI APIs, such as computer vision and text analytics, that is accessed by REST protocol. Next, we will dive into Custom AI that uses transfer learning - Microsoft Azure Custom Vision. This enables you to provide a small amount of your own data to train an image classification model. Wrapping the workshop up by building our custom trained AI into an application - using Logic Apps, this technology is ideal for building data pipeline processes that work with your machine learning models.

Making Data Scientists Productive in Azure

Valdas Maksimavičius

Slides from my talk at Big Data Conference 2018 in Vilnius Doing data science today is far more difficult than it will be in the next 5-10 years. Sharing, collaborating on data science workflows in painful, pushing models into production is challenging. Let’s explore what Azure provides to ease Data Scientists’ pains. What tools and services can we choose based on a problem definition, skillset or infrastructure requirements? In this talk, you will learn about Azure Machine Learning Studio, Azure Databricks, Data Science Virtual Machines and Cognitive Services, with all the perks and limitations.

Waking App Ltd: Next Gen AR Toolset

AugmentedWorldExpo

A talk from the Design Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Adiel Gur (Waking App Ltd) Matan Libis (Waking App Ltd) Waking App Ltd: Next Gen AR Toolset As we all know, Augmented Reality is not only an exciting new technology but a business enabler with numerous possibilities. In this presentation, Matan Libis, CEO and Adiel Gur, CTO and co-founder will demonstrate how WakingApp’s AR Toolset, ENTiTi 3.0, enables app designers, architects and construction professionals to create fabulous AR projects. Adiel will present the unique functionalities and features of ENTiTi 3.0. This will include how to integrate your AR creations into an existing mobile app and also how to create your own white label solution with our online wizard. http://AugmentedWorldExpo.com

The Wikitude SDK and the Wikitude Studio

Martin Lechner

Hyf project ideas_02

KatoK1

Microsoft Azure - The Best Platform for AI

Mayur Tendulkar

Hyf azure ml_1

KatoK1

"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...

Edge AI and Vision Alliance

For more information about embedded vision, please visit: http://www.embedded-vision.com Thanks to improvements in processors, image sensors, and algorithms, more and more of our devices now -- for the first time -- are gaining the ability to see and understand the world around them. In this talk from the June 2015 Augmented World Expo, Jeff Bier (Founder of the Embedded Vision Alliance) highlights the opportunities for creating more intelligent, interactive and insightful apps and products by harnessing embedded vision technology. From consumer electronics to smartphones to smart glasses to retail and industrial applications, vision technology enables new types of interactivity, new types of insights (for example, assessing the emotional state of users) and new types of experiences. Jeff highlights some of the coolest new products and apps leveraging vision technology, and explores some of the key trends and challenges associated with this technology.

Custom vision

Pushkar Saraf

Cognitive services in Business applications

Michele Aponte

What's hot

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...

Windows Developer

Building real time image classifiers for mobile apps with azure custom vision

Luis Beltran

Create real value in your business process by automated data and form extraction

Marvin Heng

SQLDay 2021 PL AI Enrichment Azure Search.pptx

Luis Beltran

Global Azure2021 Verona.pptx

Luis Beltran

Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...

Windows Developer

What's hot (6)

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...

Building real time image classifiers for mobile apps with azure custom vision

Create real value in your business process by automated data and form extraction

SQLDay 2021 PL AI Enrichment Azure Search.pptx

Global Azure2021 Verona.pptx

Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...

Similar to Improving your vision with Azure Cognitive Services - /dev/070

Improving your vision with Azure Cognitive Services - MixUG

Marc Duiker

Biometric Systems - Automate Video Streaming Analysis with Azure and AWS

Roberto Falconi

Computer Vision and Text Analytics Using Azure Cognitive Services

Umme Rubaiyat Chowdhury

Azure Cognitive Services로 똑똑한 서비스 만들

Hong Min Kim

Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

Pablo Farías Navarro

Getting started with microsoft cognitive services api

Jasjit Chopra

Creating applications that can see, hear, speak or understand using microso...

Radu Vunvulea

Making Data Scientists Productive in Azure

Valdas Maksimavičius

Waking App Ltd: Next Gen AR Toolset

AugmentedWorldExpo

The Wikitude SDK and the Wikitude Studio

Martin Lechner

Hyf project ideas_02

KatoK1

Microsoft Azure - The Best Platform for AI

Mayur Tendulkar

Hyf azure ml_1

KatoK1

"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...

Edge AI and Vision Alliance

Custom vision

Pushkar Saraf

Cognitive services in Business applications

Michele Aponte

How to build a serverless helmet detection system

Mandar Dharmadhikari

Microsoft Azure Power BI

Experfy

Microsoft azure

pushkar baviskar

Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services

dotnetcode

Progettatto per gli sviluppatori, il servizio di database NoSQL CosmosDB completamente gestito per lo sviluppo di app moderne con tempi di risposta garantiti inferiori a unità di millisecondi e disponibilità al 99,999% supportata da contratti di servizio, scalabilità automatica e immediata e API open source per MongoDB e Cassandra. In questa sessione illustreremo le ultime novità che riguardano la modalità Serverless, le integrazioni con il mondo AI/Cognitive Services, l’unificazione con il mondo analytics (Azure Synapse), e gli aggiornamenti sui vari SDK che lo rendono uno strumento potente e facile da usare. Speaker: Michele Arpaia (Microsoft) Video: https://youtu.be/5L_6miK9w4Y

Similar to Improving your vision with Azure Cognitive Services - /dev/070 (20)

Improving your vision with Azure Cognitive Services - MixUG

Biometric Systems - Automate Video Streaming Analysis with Azure and AWS

Computer Vision and Text Analytics Using Azure Cognitive Services

Azure Cognitive Services로 똑똑한 서비스 만들

Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

Getting started with microsoft cognitive services api

Creating applications that can see, hear, speak or understand using microso...

Making Data Scientists Productive in Azure

Waking App Ltd: Next Gen AR Toolset

The Wikitude SDK and the Wikitude Studio

Hyf project ideas_02

Microsoft Azure - The Best Platform for AI

Hyf azure ml_1

"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...

Custom vision

Cognitive services in Business applications

How to build a serverless helmet detection system

Microsoft Azure Power BI

Microsoft azure

Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services

More from Marc Duiker

Take your Azure Functions to the next level with Durable Functions - Serverle...

Marc Duiker

Take your Azure Functions to the next level with Durable Functions - WAZUG

Marc Duiker

Put Your Web App on a Diet with Azure Functions

Marc Duiker

Slides of my presentation at DUUGFest 2018 in Utrecht, NL. Abstract: Have you fed your (CMS based) web application with too much responsibility? Is the application still testable? Scalable? Resilient? Consider putting your web application on a diet by moving responsibilities outside the web app. In this talk, I'll show how you can use Azure Functions in combination with your web app. I'll demonstrate various function triggers & bindings, local development & debugging and deployment to the cloud.

Take your azure functions to the next level with durable functions @ Experts ...

Marc Duiker

Managing and querying large data sets using Data Factory, Cosmos DB and Azure...

Marc Duiker

Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup

Marc Duiker

Getting Started with Serverless Architectures using Azure Functions

Marc Duiker

More from Marc Duiker (7)

Take your Azure Functions to the next level with Durable Functions - Serverle...

Take your Azure Functions to the next level with Durable Functions - WAZUG

Put Your Web App on a Diet with Azure Functions

Take your azure functions to the next level with durable functions @ Experts ...

Managing and querying large data sets using Data Factory, Cosmos DB and Azure...

Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup

Getting Started with Serverless Architectures using Azure Functions

Recently uploaded

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Thierry Lestable

Elevating Tactical DDD Patterns Through Object Calisthenics

Dorra BARTAGUIZ

After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

DevOps and Testing slides at DASA Connect

Kari Kakkonen

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams. Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Designing Great Products: The Power of Design and Leadership by Chief Designe...

Product School

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

Product School

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

Recently uploaded (20)

Assuring Contact Center Experiences for Your Customers With ThousandEyes

Connector Corner: Automate dynamic content and events by pushing a button

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Elevating Tactical DDD Patterns Through Object Calisthenics

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

UiPath Test Automation using UiPath Test Suite series, part 4

DevOps and Testing slides at DASA Connect

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Designing Great Products: The Power of Design and Leadership by Chief Designe...

UiPath Test Automation using UiPath Test Suite series, part 3

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

When stars align: studies in data quality, knowledge graphs, and machine lear...

Improving your vision with Azure Cognitive Services - /dev/070

1. Improving your vision with Azure Cognitive Services - MixUG 1 Improving your vision with Azure Cognitive Services 13 December – /dev/070

2. About me: Marc Duiker mduiker@xpirit.comwww.xpirit.com blog.marcduiker.nl @marcduiker ‘13-’16 www.youtube.com/user/marcduiker

3. Agenda • What is Azure Cognitive Services • Computer Vision API • Azure Portal, VS Code & Visual Studio • Custom Vision API • Custom Vision portal Improving your vision with Azure Cognitive Services - /dev/070 3

4. ML & AI is hot! Improving your vision with Azure Cognitive Services - /dev/070 4

5. Improving your vision with Azure Cognitive Services - /dev/070 5

6. Improving your vision with Azure Cognitive Services - /dev/070 6

7. Cortana Intelligence Suite Improving your vision with Azure Cognitive Services - /dev/070 7

8. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs

9. Improving your vision with Azure Cognitive Services - /dev/070 9

10. Improving your vision with Azure Cognitive Services - /dev/070 10

11. Improving your vision with Azure Cognitive Services - /dev/070 11

12. Improving your vision with Azure Cognitive Services - /dev/070 12

13. Improving your vision with Azure Cognitive Services - /dev/070 13

14. Improving your vision with Azure Cognitive Services - /dev/070 14 Cognitive Services Labs https://labs.cognitive.microsoft.com/

15. Microsoft Cognitive Services Docs Improving your vision with Azure Cognitive Services - /dev/070 15

16. How did we end up here? Improving your vision with Azure Cognitive Services - /dev/070 16 Microsoft Cognitive Services Bing Search Project Oxford Microsoft CognitiveToolkit (CNTK) MicrosoftTechnology & Research 2015 2009 2016

17. Improving your vision with Azure Cognitive Services - MixUG 17 Computer Vision API

18. Computer Vision API • Recognize and understand information from images Improving your vision with Azure Cognitive Services - /dev/070 18 Tags Descriptions Faces Colors Domain models ImageType Cognitive Services Computer Vision API

19. Computer Vision API examples • API Reference • https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e c6739/operations/56f91f2e778daf14a499e1fa • Perform API calls from VS Code Improving your vision with Azure Cognitive Services - /dev/070 19

20. What do we need to get started? • Create Computer Vision API endpoint in Azure • Subscription key • Create an application to • Select an image • Do a post to the Computer Vision API endpoint Improving your vision with Azure Cognitive Services - /dev/070 20

21. Improving your vision with Azure Cognitive Services - MixUG 21

22. Demo: HelloCV • Provide a local image • Do a request to Analyze endpoint • Get analysis results back as json Improving your vision with Azure Cognitive Services - /dev/070 22 Tags Descriptions Faces Colors ImageTypeCognitive Services Computer Vision API

23. Demo: Analyze images on website Improving your vision with Azure Cognitive Services - /dev/070 23 http://... <img> <img> <img> File Scrape images Analyze Save results Cognitive Services uri uri uri Get sources Goal: Analyze images on a website

24. Cognitive Services Demo App • Computer Vision API • Analyze image • Describe image • OCR (optical character recognition) • Domain model detection: Landmarks • Emotion API • Emotion analysis Improving your vision with Azure Cognitive Services - /dev/070 24 https://github.com/marcduiker/demos-azure-cognitive-services

25. Improving your vision with Azure Cognitive Services - MixUG 25 Custom Vision API (preview)

26. Custom Vision API • Image classification Improving your vision with Azure Cognitive Services - /dev/070 26 Cognitive Services Custom Vision API Train #A #B ? #A

27. Custom Vision Demo Improving your vision with Azure Cognitive Services - /dev/070 27 Ferrari 250 GT SWB Aston Martin DB4

28. To sum it up • Ever growing collection of ‘intelligent’ APIs • Easy to get started • Choose carefully which API best suits your need • Think about confidence levels • When dealing with faces or handwriting: Personally identifiable information (PII) -> Privacy Improving your vision with Azure Cognitive Services - /dev/070 28

29. Improving your vision with Azure Cognitive Services - MixUG 29 Thanks! See you next time!

30. Marc Duiker mduiker@xpirit.com @marcduiker Xpirit Laapersveld 27 Hilversum www.xpirit.com

31. Cognitive Services Related Resources • https://azure.microsoft.com/en-us/services/cognitive-services/ • https://docs.microsoft.com/en-us/azure/cognitive-services/ • https://channel9.msdn.com/Search?term=Cognitive%20Services • https://www.microsoft.com/en-us/seeing-ai/ • https://www.microsoft.com/en-us/research/research-area/computer-vision/ • https://www.customvision.ai/ • https://github.com/marcduiker/demos-azure-cognitive-services Improving your vision with Azure Cognitive Services - /dev/070 31

Editor's Notes

Logical progression after ‘big data’. https://www.forbes.com/sites/moorinsights/2017/01/06/five-things-to-watch-in-ai-and-machine-learning-in-2017/ https://blogs.sap.com/2017/01/30/machine-learning-will-be-2017s-top-trend-and-will-help-solve-iots-big-data-challenge/ https://www.ibm.com/blogs/think/2017/02/machine-learning/
Azure Machine Learning: Create model Train model Score & test model Publish as a webservice
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
No control over training the model. Black box.
No control over training the model. Black box.
Create Computer Vision Endpoint through: - Cognitive Services and select an API - Computer Vision API
Perform demo with sites: www.nos.nl www.bbc.com/news http://designlike.com/100-most-famous-landmarks-around-the-world/
You need to train the model yourself. There are categories: food,

Improving your vision with Azure Cognitive Services - /dev/070

Recommended

Recommended

More Related Content

What's hot

What's hot (6)

Similar to Improving your vision with Azure Cognitive Services - /dev/070

Similar to Improving your vision with Azure Cognitive Services - /dev/070 (20)

More from Marc Duiker

More from Marc Duiker (7)

Recently uploaded

Recently uploaded (20)

Improving your vision with Azure Cognitive Services - /dev/070

Editor's Notes