Unite your Modern Workplace with Microsoft's AI ecosystem
@stephanbisser @thomyg
SharePoint Saturday Helsinki 28. September 2019
Kiitos, thank you our dear sponsors…
AGENDA
ABOUT US
THOMAS GÖLLES
MICROSOFT MVP (O365)
SOLVION
https://thomy.tech
@thomyg
Head of Modern Workplace Solutions
Graz, Austria
STEPHAN BISSER
MICROSOFT MVP (AI)
SOLVION
https://bisser.io
@stephanbisser
Technical Lead
Graz, Austria
bit.ly/LEARN-TO-BOT
DEFINITION
Source: http://www.boredpanda.com/fast-food-ads-vs-reality/
MODERN WORKPLACE
OFFICE365 IS
LIKE A SWISS
ARMY KNIFE …
Source: Sam Marshall, Clearbox Consulting @sammarshall
… BUT IF ONLY IT
WAS THAT SIMPLE
Source: Sam Marshall, Clearbox Consulting @sammarshall
FOCUS
ByBradGrissom@grissombrad
WHERE WORK GETS DONE
“YOU CAN’T BUY A DIGITAL WORKPLACE,
IT IS A CONCEPT NOT A PRODUCT.”Source: Sam Marshall, Clearbox
Consulting @sammarshall
ARTIFICIAL INTELLIGENCE
I’ll be back
AI
Vision
Speech
Language
AI
Vision
Speech
Language
• Face ID/Windows Hello
• Document/Image Tagging in SPO
• Image-content search in OneDrive
• Seeing AI
AI
Vision
Speech
Language
• PowerPoint Live Captions
• Stream Auto Transcripts
• Siri/Cortana
• Skype Translator
AI
Vision
Speech
Language
• Teams/Word Translate
• Sentiment Detection
• Auto Meeting minutes
• Multilingual bots
0 ≤ 𝑥 ≤ 1
EVERYTHING YOU SEE TODAY ...
“Do I need an
umbrella today?”
“… At the moment computers have an advantage of speed, but they show no
sign of intelligence.
But computers roughly obey a version of Moore’s Law, which says that their
speed and complexity double every eighteen months. …”
This is not surprising because our present computers are less complex than
the brain of an earthworm, a species not noted for its intellectual powers.
MICROSOFT
AI PLATFORM
AZURE AI
Machine learning
Azure Databricks
Azure Machine Learning
Azure AI Infrastructure
AI apps & agents
Azure Bot Service
Azure Cognitive Services
Knowledge mining
Azure Cognitive Search
For every person and every organization
DIGITAL TRANSFORMATION + AI
Artificial
Intelligence
AZURE AI PLATFORM
WHAT IS CONVERSATIONAL AI?
2000s: Mobile
• Social
• User download apps
from App Stores
The future: Conversations
• Natural language between people
and technology
• Conversational canvas
• Bots and agents
• Conversational AI
1990s: Internet
• Search
• User “visits” websites
1980s: PC
• Desktop
The evolution of computers and IT
• A new user interface paradigm
• Exposes software services through
conversational interface
• In apps, browser and on IoT devices
• Pro-active capabilities
(Virtual Assistant etc.)
• Bots
CONVERSATIONAL AI
Conversational AI is a subfield of artificial intelligence focused on producing natural and seamless
conversations between humans and computers
CONVERSATIONAL AI
Software as a service, SaaS solutions
To enable out-of-the-box conversational AI services for key solutions
Pre-trained AI, Cognitive Services
To add and customize language, speech, knowledge & vision
Managed bot service, Azure Bot Service
To accelerate building, management and deployment of conversational AI
Popular open source frameworks, Bot SDK on Github
To fully integrate and customize your solution with any AI technology
Solution accelerators and templates, PaaS
To accelerate conversational AI solutions
From the Intelligent Cloud to the Intelligent Edge
Customer Care
Bot Template
Virtual Assistant
Solution accelerator
Enterprise HR
Template
LanguageSpeech
…
DecisionVision Web search
Customer ServiceCortana, Teams Virtual Agent
BotKit SDK
Bot
Framework
Azure Bot Service
BOTS 101
“a computer program designed to
have a conversation with a human
being, especially over the internet” *
• Solves the user’s needs in the
quickest/easiest way compared to
any other option...
• Introduce AI in a friendly way
* https://dictionary.cambridge.org/dictionary/english/chatbot
MODERNIZING THE COMPANY FAQ
Company info
Departmental knowledge
Troubleshooting/support
+ ++
Office Graph
Knowledge
Sources
Manuals
(PDF)
Data Sources
General
Knowledge
Points of
Interest
Mail
Automotive
Custom
Other
Bots
Skills
(Customizable)
APIs
Directory
Tasks
Calendar
3P Assistants
Virtual Assistant
Bot Framework + Cognitive Services
Cognitive Services
Your Assistant
Your Brand
Your Personality
Language
Understanding
Speech
VisionQnA
Dispatch
Type Speak
Tap
User
Input
Devices
Channels
Azure Bot
Service
Adaptive
Cards
BOT FRAMEWORK SKILLS
Skills include language models, dialogs, and cards that can be reusable
across bots.
Skill == Bot
• Dispatcher within your core Assistant
supports Interruption
• Skills contains a self-describing Skill Manifest
 Skills are open source, fully customizable
• Skill Template
• Skill CLI
• C# and Typescript support
Office Graph
Knowledge
Sources
Manuals
(PDF)
Data Sources
General
Knowledge
Points of
Interest
Mail
Automotive
Custom
Other
Bots
Skills
(Customizable)
APIs
Directory
Tasks
Calendar
3P Assistants
Dispatch
CONVERSATIONAL MECHANISMS
• Text, with optional media
attachments
• Traditional chat, can contain
media attachments
(e.g., image, video, audio,
file)
• Input prompts
• Suggested actions: Buttons,
numbered items in a list, etc.
• Rich cards
• Images, buttons, audio,
animations, etc within one
frame – Adaptive Cards
https://ai.jumpto365.com
LANGUAGE & KNOWLEDGE
COGNITIVE SERVICES
• Machine learning-based service
to build natural language into
apps, bots, and IoT devices.
Quickly create enterprise-ready,
custom models that
continuously improve.
• New People and Geography
entity recognizers
• CLI tools and v4 SDK
integration
• CSA STAR, ISO 27001, ISO
27018, HIPAA and PCI DSS
Compliance
LANGUAGE UNDERSTANDING (LUIS)
Always learning &
improving
Enterprise Grade,
available worldwide
LANGUAGE UNDERSTANDING EXAMPLE
Book a hotel in Helsinki.
Intent = BookHotel Entity = Helsinki
LANGUAGE UNDERSTANDING EXAMPLE
{
"query": "Book a hotel in Helsinki.",
"topScoringIntent": {
"intent": "BookHotel",
"score": 0.921233
},
"entities": [
{
"entity": "Helsinki",
"type": "Location",
"startIndex": 10,
"endIndex": 13,
"score": 0.7615982
}
]
}
• Data - Aggregate and extract
knowledge from non structured
data
• Architecture. The data and
runtime hosted in your Azure
subscription.
• Data privacy and compliance.
QnA data is hosted within your
Azure compliance boundary.
• Seamless chit-chat integration
with personalities like:
Profesional; Friend; Comic.
• Azure Application Insights
integration.
QNAMAKER
KEY PARTS OF AN ENTERPRISE BOT DESIGN
DEMO
TeamsBot
Planner
FlowExchange
HELPING SALES
Text Analysis
Bit.ly/SelectedTech
bit.ly/LEARN-TO-BOT
Please give
some
feedback <3

SharePoint Saturday Helsinki 2019 - Unite your Modern Workplace with Microsoft's AI ecosystem

  • 1.
    Unite your ModernWorkplace with Microsoft's AI ecosystem @stephanbisser @thomyg SharePoint Saturday Helsinki 28. September 2019
  • 2.
    Kiitos, thank youour dear sponsors…
  • 3.
  • 4.
    ABOUT US THOMAS GÖLLES MICROSOFTMVP (O365) SOLVION https://thomy.tech @thomyg Head of Modern Workplace Solutions Graz, Austria STEPHAN BISSER MICROSOFT MVP (AI) SOLVION https://bisser.io @stephanbisser Technical Lead Graz, Austria
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
    OFFICE365 IS LIKE ASWISS ARMY KNIFE … Source: Sam Marshall, Clearbox Consulting @sammarshall
  • 11.
    … BUT IFONLY IT WAS THAT SIMPLE Source: Sam Marshall, Clearbox Consulting @sammarshall
  • 12.
  • 13.
  • 14.
    “YOU CAN’T BUYA DIGITAL WORKPLACE, IT IS A CONCEPT NOT A PRODUCT.”Source: Sam Marshall, Clearbox Consulting @sammarshall
  • 15.
  • 17.
  • 18.
    AI Vision Speech Language • Face ID/WindowsHello • Document/Image Tagging in SPO • Image-content search in OneDrive • Seeing AI
  • 19.
    AI Vision Speech Language • PowerPoint LiveCaptions • Stream Auto Transcripts • Siri/Cortana • Skype Translator
  • 20.
    AI Vision Speech Language • Teams/Word Translate •Sentiment Detection • Auto Meeting minutes • Multilingual bots
  • 21.
    0 ≤ 𝑥≤ 1 EVERYTHING YOU SEE TODAY ... “Do I need an umbrella today?”
  • 23.
    “… At themoment computers have an advantage of speed, but they show no sign of intelligence. But computers roughly obey a version of Moore’s Law, which says that their speed and complexity double every eighteen months. …” This is not surprising because our present computers are less complex than the brain of an earthworm, a species not noted for its intellectual powers.
  • 24.
  • 25.
    AZURE AI Machine learning AzureDatabricks Azure Machine Learning Azure AI Infrastructure AI apps & agents Azure Bot Service Azure Cognitive Services Knowledge mining Azure Cognitive Search For every person and every organization
  • 26.
    DIGITAL TRANSFORMATION +AI Artificial Intelligence
  • 27.
  • 28.
  • 29.
    2000s: Mobile • Social •User download apps from App Stores The future: Conversations • Natural language between people and technology • Conversational canvas • Bots and agents • Conversational AI 1990s: Internet • Search • User “visits” websites 1980s: PC • Desktop The evolution of computers and IT
  • 30.
    • A newuser interface paradigm • Exposes software services through conversational interface • In apps, browser and on IoT devices • Pro-active capabilities (Virtual Assistant etc.) • Bots CONVERSATIONAL AI Conversational AI is a subfield of artificial intelligence focused on producing natural and seamless conversations between humans and computers
  • 31.
    CONVERSATIONAL AI Software asa service, SaaS solutions To enable out-of-the-box conversational AI services for key solutions Pre-trained AI, Cognitive Services To add and customize language, speech, knowledge & vision Managed bot service, Azure Bot Service To accelerate building, management and deployment of conversational AI Popular open source frameworks, Bot SDK on Github To fully integrate and customize your solution with any AI technology Solution accelerators and templates, PaaS To accelerate conversational AI solutions From the Intelligent Cloud to the Intelligent Edge Customer Care Bot Template Virtual Assistant Solution accelerator Enterprise HR Template LanguageSpeech … DecisionVision Web search Customer ServiceCortana, Teams Virtual Agent BotKit SDK Bot Framework Azure Bot Service
  • 32.
    BOTS 101 “a computerprogram designed to have a conversation with a human being, especially over the internet” * • Solves the user’s needs in the quickest/easiest way compared to any other option... • Introduce AI in a friendly way * https://dictionary.cambridge.org/dictionary/english/chatbot
  • 33.
    MODERNIZING THE COMPANYFAQ Company info Departmental knowledge Troubleshooting/support + ++
  • 34.
    Office Graph Knowledge Sources Manuals (PDF) Data Sources General Knowledge Pointsof Interest Mail Automotive Custom Other Bots Skills (Customizable) APIs Directory Tasks Calendar 3P Assistants Virtual Assistant Bot Framework + Cognitive Services Cognitive Services Your Assistant Your Brand Your Personality Language Understanding Speech VisionQnA Dispatch Type Speak Tap User Input Devices Channels Azure Bot Service Adaptive Cards
  • 35.
    BOT FRAMEWORK SKILLS Skillsinclude language models, dialogs, and cards that can be reusable across bots. Skill == Bot • Dispatcher within your core Assistant supports Interruption • Skills contains a self-describing Skill Manifest  Skills are open source, fully customizable • Skill Template • Skill CLI • C# and Typescript support Office Graph Knowledge Sources Manuals (PDF) Data Sources General Knowledge Points of Interest Mail Automotive Custom Other Bots Skills (Customizable) APIs Directory Tasks Calendar 3P Assistants Dispatch
  • 36.
    CONVERSATIONAL MECHANISMS • Text,with optional media attachments • Traditional chat, can contain media attachments (e.g., image, video, audio, file) • Input prompts • Suggested actions: Buttons, numbered items in a list, etc. • Rich cards • Images, buttons, audio, animations, etc within one frame – Adaptive Cards
  • 37.
  • 38.
  • 39.
    • Machine learning-basedservice to build natural language into apps, bots, and IoT devices. Quickly create enterprise-ready, custom models that continuously improve. • New People and Geography entity recognizers • CLI tools and v4 SDK integration • CSA STAR, ISO 27001, ISO 27018, HIPAA and PCI DSS Compliance LANGUAGE UNDERSTANDING (LUIS) Always learning & improving Enterprise Grade, available worldwide
  • 40.
    LANGUAGE UNDERSTANDING EXAMPLE Booka hotel in Helsinki. Intent = BookHotel Entity = Helsinki
  • 41.
    LANGUAGE UNDERSTANDING EXAMPLE { "query":"Book a hotel in Helsinki.", "topScoringIntent": { "intent": "BookHotel", "score": 0.921233 }, "entities": [ { "entity": "Helsinki", "type": "Location", "startIndex": 10, "endIndex": 13, "score": 0.7615982 } ] }
  • 43.
    • Data -Aggregate and extract knowledge from non structured data • Architecture. The data and runtime hosted in your Azure subscription. • Data privacy and compliance. QnA data is hosted within your Azure compliance boundary. • Seamless chit-chat integration with personalities like: Profesional; Friend; Comic. • Azure Application Insights integration. QNAMAKER
  • 45.
    KEY PARTS OFAN ENTERPRISE BOT DESIGN
  • 46.
  • 47.
  • 48.
  • 49.
  • 50.