The document discusses various Microsoft Azure Cognitive Services including language understanding, QnA maker, immersive reader, and personalizer, detailing their functionalities and applications. It highlights features such as automated text processing, sentiment analysis, and support for over 70 languages. Additionally, it provides links to further resources and tools related to these services.

1. Azure Weekend 2020 –
A Journey with Microsoft
Azure Cognitive Service II
Marvin Heng | @hmheng
www.techconnect.io

2. What did we discuss in the past session?
• Intelligent Cloud & Intelligent Edge
• Microsoft AI
• Azure Cognitive Services
• Bing Search
• Vision
• Speech

5. What did we discuss in the past session?
• Intelligent Cloud & Intelligent Edge
• Microsoft AI
• Azure Cognitive Services
• Bing Search
• Vision
• Speech

6. Microsoft AI

7. What did we discuss in the past session?
• Intelligent Cloud & Intelligent Edge
• Microsoft AI
• Azure Cognitive Services – Why? & What?
• Bing Search – Knowledge Mining & 9 categories
• Vision
• Speech

8. Azure
Cognitive
Services
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise, identifying
speakers, and understanding intent
Process text and learn how to recognize what
users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos, and news with
the power of Bing APIs

9. Language

10. Language Understanding
• Applies custom machine-learning intelligence to a user's
conversational, natural language text to predict overall meaning,
and pull out relevant, detailed information.
• Often used in Chatbots or conversational bots.

11. Language Understanding

12. Use Cases of Language Understanding
• Automate capturing order for your application
• Automate social media feedback & response
• Conversation bot for your HR service, IT service, or other
customer services.
• Integrate with speech services for enabling your app to
responding voice request from users.

14. QnA Maker
• Natural Language Processing (NLP) service
• Create a natural conversational layer over your data
• Find the most appropriate answer for any input from your custom
knowledge base (KB) of information

15. Development Lifecycle for QnA Maker

17. Immersive Reader
• Embed text reading and comprehension capabilities into
applications
• Features:
• Reading aloud,
• translating languages, and
• focusing attention through highlighting
• No machine learning expertise is required.

18. Shows content in a minimal reading view

19. Displays pictures of commonly used words

20. Highlights nouns, verbs, adjectives, and adverbs

21. Reads your content out loud to you

22. Translates your content into another language

23. Breaks down words into syllables

24. What proves that Immersive Reader helps
people with reading?
• A 2017 study by RTI International showed that reading comprehension
among groups of fourth-grade students improved an average of 10
percent. Read the research.

26. Translator
• Support over 70+ languages & customizable.
• Easy integration via REST API

27. Text Analytics
• For text mining and text analysis
• Understand the context in a conversation better
• Sentiment analysis, opinion mining, key phrase extraction,
language detection, and named entity recognition
• More than 20 languages being supported (reference)

29. Text Analytics for Health
• Extract information from unstructured English-language text in
clinical documents such as: patient intake forms, doctor's notes,
research papers and discharge summaries

31. Decision

32. Personalizer
• Provide information about your users and content and receive the
top action to show your users.
• No need to clean and label data before using Personalizer.
• Provide feedback to Personalizer when it is convenient to you.
• View real-time analytics.
• Use Personalizer as part of a larger data science effort to validate
existing experiments.

33. Personalizer

34. Personalizer

35. Where can I use Personalizer?
• Personalize what article is highlighted on a news website.
• Display a personalized "recommended item" on a shopping
website.
• Suggest user interface elements such as filters to apply to a
specific photo.

36. Where can I use Personalizer?
• Send information (features) about your users and the content
(actions) to personalize. Personalizer responds with the top action.
• Send feedback to Personalizer about how well the ranking worked
as a number typically between 0 and 1.

38. Extras Add-on:
• Cognitive Service
• https://github.com/Azure-Samples/cognitive-services-python-sdk-
samples/tree/deb4483ec1db33138e32ce472a775f3ed874fb80?WT.mc_id=AI-MVP-5003227
• Personalizer
• https://azure.microsoft.com/en-us/services/cognitive-services/personalizer?WT.mc_id=AI-MVP-5003227
• https://personalizationdemo.azurewebsites.net
• Speech-To-Text
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text?WT.mc_id=AI-MVP-5003227
• Speech
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text?WT.mc_id=AI-MVP-5003227
• https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis-
markup?WT.mc_id=AI-MVP-5003227

39. Extras Add-on:
• Bing Search
• https://docs.microsoft.com/en-us/azure/cognitive-services/bing-web-search?WT.mc_id=AI-MVP-5003227
• Personalizer
• https://azure.microsoft.com/en-us/services/cognitive-services/personalizer?WT.mc_id=AI-MVP-5003227
• https://personalizationdemo.azurewebsites.net
• Speech-To-Text
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text?WT.mc_id=AI-MVP-5003227
• Speech
• https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text?WT.mc_id=AI-MVP-5003227
• https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis-
markup?WT.mc_id=AI-MVP-5003227

40. Extras Add-on:
• Form Recognizer:
• https://docs.microsoft.com/en-us/azure/cognitive-services/form-
recognizer/language-support?WT.mc_id=AI-MVP-5003227
• https://docs.microsoft.com/en-us/azure/cognitive-services/form-
recognizer/quickstarts/label-tool?WT.mc_id=AI-MVP-5003227
• Form OCR Testing Tool
• On Azure @ https://fott.azurewebsites.net/
• GitHub @ https://github.com/microsoft/OCR-Form-
Tools/?ocid=AID2463683&WT.mc_id=AI-MVP-5003227

41. Things you may be interested in.
•AI Labs@hmheng (GitHub):
https://github.com/hmheng/AILabs