This document provides information on building intelligent bots using Azure Bot Service and Cognitive Services. It discusses using pre-built AI like Cognitive Services APIs or custom AI with Azure Machine Learning. It also summarizes capabilities of Azure Bot Service like integrating various channels, using the Bot Builder SDK, and deploying bots to Azure. Examples of building speech, vision, and question-answering bots are also provided.

1. Build Intelliget Bot
AntimoMusone - ICT Architect
MVPMicrosoft - Intel Innovator
https://www.linkedin.com/in/antimo-musone/
Email: antimo.musone@hotmail.com
Twitter: @mrazure
Roma 27-06-2018

2. Antimo Musone
❑ ICT Manager & Architect
❑ Manager in Ernst & Young
❑ Co-Founder Fifth Ingenium
❑ MVP Microsoft - Intel Innovator
https://www.linkedin.com/in/antimo-musone/

12. Bringing the best of AI to Azure and the best of Azure to AI
Pre-Built AI
Azure Cognitive Services
Conversational AI
Azure Bot Service
Custom AI
Azure Machine Learning
Understand & interpret
meaning of data including
text, voice, images
Engage with users in natural
ways
Reason, learn & form
conclusions from data

14. Powerful prebuilt AI models exposed as API services
Simple REST APIs with .NET, Java, Python, Node SDKs
Easily customize for highest accuracy
Train in the cloud and deploy anywhere
Vision
Speech
Language
Conversation
Bing Search
Knowledge

15. Ingest Enrich Explore
Data Cognitive Skills API Request & Search
Cognitive Search
AN AI–FIRST APPROACH TO CONTENT UNDERSTANDING
https://westus.dev.cognitive.microsoft.com/docs/services?page=2

16. Vision
1. The Computer Vision API extracts rich information about images (such as objects or people),
determines if the image contains mature or explicit content, and processes text (using OCR) in
images.
2. Custom Vision lets you build custom image classifiers. It makes it easy and fast to build,
deploy, and improve an image classifier.
3. The Face API detects human faces & emotions compares them to similar faces, and can even
organize people into groups according to visual similarity.
4. The Video API analyzes and processes video to stabilize video output, detects motion, tracks
faces, and can generate a motion thumbnail summary of the video.
5. Content Moderator machine-assisted content moderation APIs and human review tool for
images, text, and videos

17. Speech Recognition
1. The Speech to Text provides automatic speech recognition and speech transcription
(speech-to-text). Customizable speech recognition , speech transcription and speech
models for unique vocabularies or accents.
2. The Text to Speech provide automatic text-to-speech and you to create customizable
voice fonts for text-to-speech.
3. The Speaker Recognition API enables speaker identification and verification through
voice.
4. Speech Translation is a cloud-based automatic translation service which enables
developers to add end-to-end, real-time, speech translations to their applications or
services.

18. Language & Conversation
1. The Language Understanding Intelligent Service (LUIS) is able to process natural language
using pre-built or custom-trained language models.
2. The Text Analytics API detects sentiment, key phrases, topics, and language from text.
Automatically detect languages. Add online and offline translation support into your App.
3. The Bing Spell Check API provides powerful spell check capabilities and is able to recognize
the difference between names, brand names, and slang.
4. The Translator Text conduct real-time text translation with a simple REST API call
5. The Content Moderator machine-assisted content moderation APIs and human review tool
for images, text, and videos

19. Bing Search
1. The Web Search API provides web, image, video, news and related search results with a
single API call.
2. The Image Search API returns image results with enhanced metadata (dominant color,
image kind, etc.) and supports several image filters to customize the results.
3. The Video Search API retrieves video results with rich metadata (video size, quality, price,
etc.), video previews, and supports several video filters to customize the results.
4. The News Search API finds news articles around the world that match your search query or
are currently trending on the Internet.
5. The Autosuggest API offers instant query completion suggestions to complete your search
query faster and with less typing.
6. The Visual Search recognize celebrities, monuments, artwork, and other related objects.
Identify barcodes or extract textual information from images to provide rich insights

20. Knowledge Extraction
1. The Entity Linking Intelligence Service annotates unstructured text with the relevant entities
mentioned in the text. Depending on the context, the same word or phrase may refer to
different things.
2. The Knowledge Exploration Service provides natural language interpretation of user queries and
returns annotated interpretations to enable rich search and auto-completion experiences that
anticipate what the user is typing.
3. The Academic Knowledge API returns academic research papers, authors, journals, conferences,
topics, and universities from the Microsoft Academic Graph.
4. The QnA Maker is a free, easy-to-use, REST API and web-based service that trains AI to respond
to users’ questions in a natural, conversational way.
5. Project Conversation Learner enables you to build and teach conversational interfaces that learn
from example interactions. Unlike traditional approaches, considers the end-to-end context of a
dialogue to help improve responses and deliver more compelling user experiences

21. Custom Vision
Easily customize your own state-of-the-art
computer vision models that fit perfectly with
your unique use case. Just bring a few examples
of labeled images and let Custom Vision do the
hard work.

24. DEMO
CUSTOM VISION

25. QnA Maker

26. DEMO
QnA Maker

27. November 22, 1963
John F. Kennedy (JFK)

28. https://aka.ms/jfk-files

29. User Input Channels Bot Intelligence Business Process
Build Intelligent BOT : Azure Bot Service + Cognitive Services

30. BotBuilder
SDK
Direct Line Protocol

31. Open Framework Multiple Canvases
Notification Microsoft Teams Skype Android iOS

32. Bing Speech API
Convert speech to text and back
again, and understand its intent
Speaker Recognition API
Give your app the ability
to know who's talking
Custom Speech Service
Fine-tune speech recognition for
anyone, anywhere
QnA Maker
Distill information into conversational,
easy-to-navigate answers
Language Understanding
Intelligent Service
Teach your apps to understand
commands from your users
Translator
Easily perform speech
and text translation
Azure Search
Integrate search into a
conversational experience

33. Author Dialogs
Design Cards
Visualize
Bot Builder SDK
Cognitive
Services
Getting Started
Templates
Emulator
Application
Insights
Emulator
DevOps Tools
Azure
BYO Web Host
WebChat
Cortana
Skype, FB
+
Custom
(DirectLine)
Application
Insights
LUIS Suggestions
Create a Conversation with BotService
Comprehensive framework for the lifecycle of your project

34. Choose your platform
STEP 1
Quickly get started
• VSIX and Yeoman templates
STEP 2
Deploy your bot
• Azure Bot Service
• On-premise hosting
• Hybrid hosting
STEP 3
Scenario focused samples
• Commerce chatbot
• Information chatbot
• Enterprise chatbot

35. DEMO
Speech Bot

36. DEMO
Custom Vision Bot

37. Antimo Musone - IT Architect
MVP Microsoft – Intel Innovator
https://www.linkedin.com/in/antimo-musone/
Email: antimo.musone@hotmail.com
Twitter: @mrazure