Nick Landry
Senior Technical Evangelist – Microsoft
activenick@microsoft.com
Blog: AgeofMobility.com
@ActiveNick | github.com/ActiveNick
Bots are the New Apps:
Building Bots with ASP.NET Web API
& Language Understanding
TYPE TALK TAP
Bot Builder
Platform
Services
Intelligent Tools
{ Your Code }
REST Endpoint
Direct Line Protocol
Conversational and
Business Logic
Canvas Aware Context
Sensitive
SDK
Bot Builder SDK
Platform Platform Services
HTTP
REST Endpoint
AI
Intelligent Tools
Goals
• Start Simple. Add Complexity. No dead-ends.
• Bot adapts to the user, based on context
• Composable and intelligent controls to manage complexity
Bot Controls
LUIS
Query over database via
Azure Search
Form
Filling
QnA
C#
Customer’s
Business Logic
& DataBot Connector
Direct Line
What?
• Tools for building REST Web Sites
• Services to enrich
• Mechanisms for receive events
• Data to debug and analyze
Why?
• Implements standard protocols
• Modeling conversations is hard. Tools help!
• UI across multiple canvases is hard. Cards rock!
• Language Understanding is hard
• Common and well understood patterns
O N E B O T
M U L T I P L E C A N V A S E S
O N E B O T
M U L T I P L E C A N V A S E S
Custom Skills
Memory / Profile
Speech
Business Bots
Bot Directory
Bots in Bing Search
LOB Bots
IT Managed
Integrated Auth
Demo: Let’s build a bot!
Get started at https://www.botframework.com
Emotion
Speaker
Recognition
Speech
Custom
Recognition
Computer Vision
Face
Video
microsoft.com/cognitive
Linguistic Analysis
Language
Understanding
Bing Spell Check
Entity Linking
Knowledge
Exploration
Academic
Knowledge
Bing
Image Search
Bing
Video Search
Bing
Web Search
WebLM
Text Analytics Recommendations
Bing
Autosuggest
Bing
News Search
Translator
https://www.microsoft.com/cognitive-services/
Demo: Natural Language
Understanding with LUIS
Get started at https://www.luis.ai
(*) Recognizers are open-sourced.
More New Features
L A N G U A G E U N D E R S T A N D I N G
Top Requested Features
Production Staging and Versioning
More Languages (Dutch, Korean, dialects)
Increased Intent and Entity Limits
25 Customizable Prebuilt Domains
Lists
Improved Recognizers(*)
Semantic Dictionaries
Spell Checking
Predefined packages
Bootstrap model creation
Customizable!
Pre-Built Domains
Sports
Weather
Stock
Contacts
Calendar
Restaurants
Examples of Pre-Built Domains
L A N G U A G E U N D E R S T A N D I N G
Entertainment
Fitness
Home Automation
Music
Translation
Movie Tickets
Adaptive Cards
O P E N F R A M E W O R K
M U L T I P L E C A N V A S E S
Notification Microsoft Teams Skype Android iOS
Demo: Adaptive Cards
Get started at https://adaptivecards.io/
Microsoft Seller Center
Stripe is currently supported
Visit Microsoft Seller Center
Obtain MerchantID
Start building
Works across most major platforms
Fast and simple payment experience
Bring commerce capabilities to your Bot
Read the integration guide for the Bot Framework.
SPEECH IN PROTOCOLS
DirectLine Support
WebChat Control
Cortana
SPEECH IN SDKS SPEECH IN LUIS
SSML
Speech Friendly Prompts
Conversation Management
Modeled Conversations
Common Model (Cortana,
Bing Speech, Custom
Speech Recognition)
D E E P I N T E G R A T I O N
A C R O S S T H E B O T F R A M E W O R K
H O L I S T I C B O T B U I L D I N G
Fully Azure Integrated
Conversational vs Business Logic
Richly Tooled
Design. Code. Deploy. Manage. Analyze.
“One Stop Shop for building Bots”
Data stays in a user’s subscription
Improved Perf via colocation
• Bot + Functions + LUIS Runtime
SDK Unification
Componentization and Reuse
Highlights
Bot Builder
Protocols &
Services &
Channels
Bot
Intelligence
Azure Bot
Service v2
Speech
Support
Ecosystem Integrations
(Flow, PowerApps, ++)
Bot Brain
Bot Controls++
GA
GA
GA
GA
Analytics++
Regions++,
Channels++
SDK V.Next
Localization
Adaptive Cards
Bot
Federation
Compliance
May Aug Nov
Regions++, Languages++, Domains++ ML Dialogs
Pattern
Support
Faster
Training
Multi-
Developer
Prebuilt
Domains
Speech
Services++
Public
Preview
Private
Preview
https://dev.botframework.com/
https://github.com/Microsoft/BotBuilder
https://blog.botframework.com/
http://developer.microsoft.com/cortana
https://channel9.msdn.com/Events/Build/2017?tag=bot%2Bframework
Thank You!
Slides are on Slideshare. Demos are on GitHub.
Contact me and let me know what you build, I will be happy to help promote your bots.
Blog: AgeofMobility.com
Twitter: @ActiveNick
Email: activenick@microsoft.com
Apps: www.bigbaldapps.com
LinkedIn: linkedin.com/in/activenick
GitHub: github.com/ActiveNick
Slideshare: slideshare.net/ActiveNick
Bots are the New Apps: Building Bots with ASP.NET WebAPI & Language Understanding

Bots are the New Apps: Building Bots with ASP.NET WebAPI & Language Understanding

  • 1.
    Nick Landry Senior TechnicalEvangelist – Microsoft activenick@microsoft.com Blog: AgeofMobility.com @ActiveNick | github.com/ActiveNick Bots are the New Apps: Building Bots with ASP.NET Web API & Language Understanding
  • 5.
    TYPE TALK TAP BotBuilder Platform Services Intelligent Tools
  • 6.
    { Your Code} REST Endpoint Direct Line Protocol Conversational and Business Logic Canvas Aware Context Sensitive SDK Bot Builder SDK Platform Platform Services HTTP REST Endpoint AI Intelligent Tools
  • 7.
    Goals • Start Simple.Add Complexity. No dead-ends. • Bot adapts to the user, based on context • Composable and intelligent controls to manage complexity Bot Controls LUIS Query over database via Azure Search Form Filling QnA C# Customer’s Business Logic & DataBot Connector Direct Line What? • Tools for building REST Web Sites • Services to enrich • Mechanisms for receive events • Data to debug and analyze Why? • Implements standard protocols • Modeling conversations is hard. Tools help! • UI across multiple canvases is hard. Cards rock! • Language Understanding is hard • Common and well understood patterns
  • 8.
    O N EB O T M U L T I P L E C A N V A S E S
  • 9.
    O N EB O T M U L T I P L E C A N V A S E S Custom Skills Memory / Profile Speech Business Bots Bot Directory Bots in Bing Search LOB Bots IT Managed Integrated Auth
  • 10.
    Demo: Let’s builda bot! Get started at https://www.botframework.com
  • 11.
    Emotion Speaker Recognition Speech Custom Recognition Computer Vision Face Video microsoft.com/cognitive Linguistic Analysis Language Understanding BingSpell Check Entity Linking Knowledge Exploration Academic Knowledge Bing Image Search Bing Video Search Bing Web Search WebLM Text Analytics Recommendations Bing Autosuggest Bing News Search Translator https://www.microsoft.com/cognitive-services/
  • 12.
    Demo: Natural Language Understandingwith LUIS Get started at https://www.luis.ai
  • 13.
    (*) Recognizers areopen-sourced. More New Features L A N G U A G E U N D E R S T A N D I N G Top Requested Features Production Staging and Versioning More Languages (Dutch, Korean, dialects) Increased Intent and Entity Limits 25 Customizable Prebuilt Domains Lists Improved Recognizers(*) Semantic Dictionaries Spell Checking
  • 14.
    Predefined packages Bootstrap modelcreation Customizable! Pre-Built Domains Sports Weather Stock Contacts Calendar Restaurants Examples of Pre-Built Domains L A N G U A G E U N D E R S T A N D I N G Entertainment Fitness Home Automation Music Translation Movie Tickets
  • 15.
    Adaptive Cards O PE N F R A M E W O R K M U L T I P L E C A N V A S E S Notification Microsoft Teams Skype Android iOS
  • 16.
    Demo: Adaptive Cards Getstarted at https://adaptivecards.io/
  • 17.
    Microsoft Seller Center Stripeis currently supported Visit Microsoft Seller Center Obtain MerchantID Start building Works across most major platforms Fast and simple payment experience Bring commerce capabilities to your Bot Read the integration guide for the Bot Framework.
  • 18.
    SPEECH IN PROTOCOLS DirectLineSupport WebChat Control Cortana SPEECH IN SDKS SPEECH IN LUIS SSML Speech Friendly Prompts Conversation Management Modeled Conversations Common Model (Cortana, Bing Speech, Custom Speech Recognition) D E E P I N T E G R A T I O N A C R O S S T H E B O T F R A M E W O R K
  • 19.
    H O LI S T I C B O T B U I L D I N G Fully Azure Integrated Conversational vs Business Logic Richly Tooled Design. Code. Deploy. Manage. Analyze. “One Stop Shop for building Bots” Data stays in a user’s subscription Improved Perf via colocation • Bot + Functions + LUIS Runtime SDK Unification Componentization and Reuse Highlights
  • 20.
    Bot Builder Protocols & Services& Channels Bot Intelligence Azure Bot Service v2 Speech Support Ecosystem Integrations (Flow, PowerApps, ++) Bot Brain Bot Controls++ GA GA GA GA Analytics++ Regions++, Channels++ SDK V.Next Localization Adaptive Cards Bot Federation Compliance May Aug Nov Regions++, Languages++, Domains++ ML Dialogs Pattern Support Faster Training Multi- Developer Prebuilt Domains Speech Services++ Public Preview Private Preview
  • 21.
  • 22.
    Thank You! Slides areon Slideshare. Demos are on GitHub. Contact me and let me know what you build, I will be happy to help promote your bots. Blog: AgeofMobility.com Twitter: @ActiveNick Email: activenick@microsoft.com Apps: www.bigbaldapps.com LinkedIn: linkedin.com/in/activenick GitHub: github.com/ActiveNick Slideshare: slideshare.net/ActiveNick