The document discusses conversational AI applications within Microsoft Teams, highlighting the evolution of technology from traditional interfaces to natural language conversations with AI. It covers the functionality of bots, such as automating tasks and providing user support through platforms like the Microsoft Bot Framework and QnA Maker. Additionally, it describes integrating cognitive services for enhanced language understanding and the framework for the lifecycle of AI projects.

1. 06.04.2019
#
2019
#
Conversational AI applications in
Microsoft Teams

2. 06.04.2019
#
Sponsors and Partners

3. ABOUT US
THOMAS GÖLLES
MICROSOFT MVP (O365)
SOLVION
https://thomy.tech
@thomyg
Head of Modern Workplace Solutions
Graz, Austria
STEPHAN BISSER
MICROSOFT MVP (AI)
SOLVION
https://www.cloudguy.pro
@cloudguy_pro
Technical Lead
Graz, Austria

5. DEFINITION

6. Source: http://www.boredpanda.com/fast-food-ads-vs-reality/

7. ARTIFICIAL INTELLIGENCE
I’ll be back

9. 0 ≤ 𝑥 ≤ 1
EVERYTHING YOU SEE TODAY ...
“Do I need an
umbrella today?”

11. “… At the moment computers have an advantage of speed, but they show no
sign of intelligence.
But computers roughly obey a version of Moore’s Law, which says that their
speed and complexity double every eighteen months. …”
This is not surprising because our present computers are less complex than
the brain of an earthworm, a species not noted for its intellectual powers.

12. MICROSOFT
AI PLATFORM

13. Conversational AI

14. WHAT IS CONVERSATIONAL AI?

15. 2000s: Mobile
• Social
• User download apps
from App Stores
The future: Conversations
• Natural language between people
and technology
• Conversational canvas
• Bots and agents
• Conversational AI
1990s: Internet
• Search
• User “visits” websites
1980s: PC
• Desktop
The evolution of computers and IT

16. • A new user interface paradigm
• Exposes software services through
conversational interface
• In apps, browser and on IoT devices
• Pro-active capabilities
(Virtual Assistant etc.)
• Bots
CONVERSATIONAL AI
Conversational AI is a subfield of artificial intelligence focused on producing natural and seamless
conversations between humans and computers

17. BOTS 101
“a computer program designed to have a
conversation with a human being, especially over
the internet” *
* https://dictionary.cambridge.org/dictionary/english/chatbot

18. • It’s one thing: it’s an app that performs an automated task
• It solves the user’s needs in the quickest/easiest way compared to any
other option... like an app, or a website
BOTS 101

19. • Automate routine work
• Faster transactions
• Introduce AI in a friendly way
THE BUSINESS CASE FOR BOTS
…

20. MODERNIZING THE COMPANY FAQ
Company info
Departmental knowledge
Troubleshooting/support
+ ++

21. QNA MAKER

22. • Data - Aggregate and extract
knowledge from non structured
data
• Architecture. The data and
runtime hosted in your Azure
subscription.
• Data privacy and compliance.
QnA data is hosted within your
Azure compliance boundary.
• Seamless chit-chat integration
with personalities like:
Profesional; Friend; Comic.
• Azure Application Insights
integration.
QNAMAKER

24. BOTS 101
{ Your Code }
REST Endpoint

25. MICROSOFT BOT FRAMEWORK
Users
Direct Line
Mail
Bing
kik
Facebook
Messenger
Web Chat
3rd Party
3rd
Slack GroupMe
CortanaMicrosoft Teams
Telegram
Twilio (SMS)
SkypeOffice 365
Channels Conversational AI Platform
Functions BotWeb App Bot Bot Channels Registration Bot Service Types
Bot Builder SDKs
C#
.NET SDK Java SDK*JavaScript SDK Python SDK*
Cognitive ServicesVision Speech Search Language Knowledge
Patterns & ConceptsRecognizers CardsMiddlewareState Dialogs
HostingMicrosoft Azure On-premises Other Cloud Service Providers
* still in preview

26. HOW BOTS WORK

27. ACTIVITY PROCESSING STACK

28. MIDDLEWARE
• 1st middleware object’s turn handler
executes code before calling next.
• 2nd middleware object’s turn handler
executes code before calling next.
• The bot’s turn handler executes and
returns.
• 2nd middleware object’s turn handler
executes any remaining code before
returning.
• 1st middleware object’s turn handler
executes any remaining code before
returning.
next()
next()
1st
middleware
2nd
middleware
Bot logic

29. STATE MANAGEMENT

30. .BOT FILE
With a .bot file, you can register services like:
• Localhost local debugger endpoints
• Azure Bot Service registrations.
• LUIS.AI gives your bot the ability to communicate with people using natural language..
• QnA Maker Build, train and publish a simple question and answer bot based on FAQ
URLs, structured documents or editorial content in minutes.
• Dispatch models for dispatching across multiple services.
• Azure Application Insights for insights and bot analytics.
• Azure Blob Storage for bot state persistence.
• Azure Cosmos DB - globally distributed, multi-model database service to persist bot
state.

31. Point of
Interest
Mail
Automotive
Custom
Hospitality
Conversation Skills
(Customisable)
APIs
Productivity
1st/3rd Party
Directory
Tasks
Calendar
AI
Capabilities
Language
Understanding
Speech
Vision
QnA
Knowledge
Sources
Manuals
(PDF)
Data Sources
General
Knowledge
3rd Party
Assistants
IoT Edge
Devices
Type Speak
Tap
User
Input
Adaptive
Cards
Channels
Azure Bot
Services
Virtual Assistant
Your Brand
Your Personality
Dialogs
Language Model
Virtual Assistant
Your brand, your assistant

32. • Text, with optional media attachments
• Traditional chat, can contain media attachments
(e.g., image, video, audio, file)
• Input prompts
• Suggested actions: Buttons, numbered items in a list, etc.
• Rich cards, rendered as a list or carousel
• Images, buttons, audio, animations, video, user sign-in,
etc.
• Hero | Audio | Animation | Thumbnail | Receipt | Sign In
|
Video | Adaptive | Purchase
• Speech
• Text-based chat using Speech Recognition & Synthesis
(TTS)
CONVERSATIONAL MECHANISMS

33. https://ai.jumpto365.com

34. LANGUAGE & KNOWLEDGE
COGNITIVE SERVICES

35. • Machine learning-based service
to build natural language into
apps, bots, and IoT devices.
Quickly create enterprise-ready,
custom models that
continuously improve.
• New People and Geography
entity recognizers
• CLI tools and v4 SDK
integration
• CSA STAR, ISO 27001, ISO
27018, HIPAA and PCI DSS
Compliance
LANGUAGE UNDERSTANDING (LUIS)
Always learning &
improving
Enterprise Grade,
available worldwide

36. LANGUAGE UNDERSTANDING EXAMPLE
Book a hotel in Warsaw.
Intent = BookHotel Entity = Warsaw

37. LANGUAGE UNDERSTANDING EXAMPLE
{
"query": "Book a hotel in Warsaw.",
"topScoringIntent": {
"intent": "BookHotel",
"score": 0.921233
},
"entities": [
{
"entity":“Warsaw",
"type": "Location",
"startIndex": 10,
"endIndex": 13,
"score": 0.7615982
}
]
}

39. THE LIFECYCLE OF YOUR PROJECT
Comprehensive framework for the lifecycle of your project
Plan Build Test Publish Connect Evaluate
Author Dialogs
Design Cards
Visualize
Bot Builder SDK
Cognitive Services
Getting Started
Templates
Emulator​
Application
Insights
Conversation
Transcripts
DevOps Tools
Azure
BYO Web Host
WebChat
Cortana
Skype, FB
+
Custom
(DirectLine)
Application
Insights
LUIS
Suggestions

40. DEMOS TILL THE END ;)

41. FREE BOT WEBINAR –
PLEASE GIVE
FEEDBACK
http://bit.ly/bot_webinar_feedback

42. 06.04.2019
#
06.04.2019
#