SlideShare a Scribd company logo
1 of 16
THE VIRTUAL ASSISTANT TOUR
HI, I M YOUR CORTANA
Asish Padhy
@AsishPadhy
HELLO, HOLA, NAMASTE,
NI HAO…
• Tech Lover and Enthusiast
• 14+ years of building solutions
• Architect and Developer in M365, Azure, AI
and lot many ...
@AsishPadhy
AGENDA
• Microsoft Teams and Bots
• Virtual Assistant Intro
• What it means for organization
• Components & Template
• Design Flow
• Demo
• Skills
• Use Cases and Things to know
@AsishPadhy
MICROSOFT TEAMS
AND BOTS
• Teams acts as hosting interface for Bots
• Bots are code running in Azure App
Service and listening to Team events
• Bots use multiple Azure Cognitive
Services such as
• LUIS
• QNA Maker
• Image
• Speech
• Responses from Bots are fed back using
Channels such as Teams App
@AsishPadhy
VIRTUAL ASSISTANT
• Cumulative Bots Experience tailored to your
brand
• Conversational Assistant across broad range
of applications
• Personalized to Users and brand
• Extensible with Skills
• Provides a great starting point with
Templates
@AsishPadhy
VIRTUAL ASSISTANT
@AsishPadhy
Business Ownership
Custom Abilities
o Create own knowledge base
o Get information specific to
particular business
requirements
o Create a map of existing data
with the business need
o Owned Processes
o Add skills / abilities as per your
business requirement
o Provide more skillful actions for
user actions such as automated
prompts, activity tracking etc.
o Create a custom flow that works
with your business processes
o Experience and build value
o Start with an existing
template build on Microsoft
experiences
o Focusses on combination of
services and strength of
using each
o Build and extend as you go
Starting Point
o New or existing bots
o Extensible
o Programmable
VIRTUAL
ASSISTANT
TOUR
@AsishPadhy
o Access Points
o E.g. Teams, Emails, Web, Speech
o Document Repositories
o Line of Business databases
o CRM and Employee Systems
o Offload complexity and intelligence
o LUIS, QNA Maker, Azure Search
VIRTUAL ASSISTANT
@AsishPadhy
Content
Moderator
Telemetry
Virtual Assistant
Dispatch
LUIS QnA
Skills
Bot
Skill 1
Bot
Skill 2
• Focus on Routing requests
• Core scalability with Dispatch tool
• Support for Telemetry (analytics)
• Support for Content Moderation
• Core support from LUIS and QnA services
• Extensibility with Skills with existing bot
functionalities
VIRTUAL ASSISTANT FLOW
@AsishPadhy
•Knowledge
Sources
•Channels
•User Inputs
•Skills
Define
•Virtual
Assistant
•QNA Maker
•Custom Skills
Build
•Azure
Hosting
•Channel
Hosting
•AI Hosting
Deploy
DEMO
I AM YOUR CORTANA
@AsishPadhy
• Provide a way to expand on available or new
conversational or AI abilities
• Addons at Organizational scope
• Skills allows to reuse existing conversational
features
• Some startup template skills provided by Microsoft
• E.g.
• Email Skill
• Todo Skill
• Calendar Skill
SKILLS
@AsishPadhy
CUSTOM SKILLS
• Provided Skill template as a starting point
• Extend an existing custom bot to skill
• Add the skill to virtual assistant using botskills
command
• Update the dispatch skill in assistant
• Support Authentication
• Available Skills CLI tool
@AsishPadhy
USE CASES
• Single routing interface for multiple
bot scenarios
• Automated learning platform with
extension to multiple channels
•E.g.
• Customer Service Request
• Planner and Organizer
• Go to Help / Support Request
@AsishPadhy
@AsishPadhy
THINGS TO KNOW
 Update Template.json to customize the virtual
assistant azure resources deployment
 Quickly train QnA and LUIS using LU files in
Resources folder under Deployment
 Activate LUIS and assign authoring key to prevent
service drops
 Identify load and plan cost for Azure Search RPUs
 Update Skills dialog for custom prompts and flow
 Deploy the skill to Virtual Assistant after complete
individual testing using bot emulator
 Don’t make skill too specific or heavy. Keep it light and
scalable
 Create more granular independent skills
 Use Direct line Speech for easy accessibility
@AsishPadhy
HELP
Skills
Virtual assistant
Sample Skills Repo
(C#)
Create Virtual
Assistant
Create Skill
https://docs.microsoft.com/en-us/azure/bot-service/bot-
builder-skills-overview?view=azure-bot-service-4.0
https://docs.microsoft.com/en-us/azure/bot-service/bot-builder-
virtual-assistant-introduction?view=azure-bot-service-4.0
https://github.com/microsoft/botframework-
solutions/tree/master/skills/csharp
https://microsoft.github.io/botframework-solutions/virtual-
assistant/tutorials/create-assistant/csharp/1-intro/
https://microsoft.github.io/botframework-
solutions/skills/tutorials/create-skill/csharp/1-intro/
THANK YOU!
Twitter
@asishpadhy
LinkedIn
https://linkedin.com/in/asishpadhy
Blog
https://asishpadhy.com

More Related Content

What's hot

5 things for immediate impact on increasing SharePoint adoption
5 things for immediate impact on increasing SharePoint adoption5 things for immediate impact on increasing SharePoint adoption
5 things for immediate impact on increasing SharePoint adoptionAsif Rehmani
 
A Business Perspective on Building SharePoint 2013 Solutions on Windows Azure
A Business Perspective on Building SharePoint 2013 Solutions on Windows AzureA Business Perspective on Building SharePoint 2013 Solutions on Windows Azure
A Business Perspective on Building SharePoint 2013 Solutions on Windows AzureChristian Buckley
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine LearningRene Modery
 
SPBiz - Practical Advice for developing your SharePoint Roadmap
SPBiz - Practical Advice for developing your SharePoint RoadmapSPBiz - Practical Advice for developing your SharePoint Roadmap
SPBiz - Practical Advice for developing your SharePoint RoadmapRene Modery
 
MN Govt IT Symposium - SharePoint 2013 The Next Stage In Evolution
MN Govt IT Symposium - SharePoint 2013 The Next Stage In EvolutionMN Govt IT Symposium - SharePoint 2013 The Next Stage In Evolution
MN Govt IT Symposium - SharePoint 2013 The Next Stage In EvolutionDon Donais
 
The People's Innovation Platform - Microsoft Power Platform
    The People's Innovation Platform - Microsoft Power Platform    The People's Innovation Platform - Microsoft Power Platform
The People's Innovation Platform - Microsoft Power PlatformKorcomptenz Inc
 
O365Con18 - New Era of Customizing - Olli Jaaskelainen
O365Con18 - New Era of Customizing - Olli JaaskelainenO365Con18 - New Era of Customizing - Olli Jaaskelainen
O365Con18 - New Era of Customizing - Olli JaaskelainenNCCOMMS
 
O365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
O365Con19 - Model-driven Apps or Canvas Apps? - Rick BakkerO365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
O365Con19 - Model-driven Apps or Canvas Apps? - Rick BakkerNCCOMMS
 
VJCD2017 SharePoint Framework (SPFx)
VJCD2017 SharePoint Framework (SPFx)VJCD2017 SharePoint Framework (SPFx)
VJCD2017 SharePoint Framework (SPFx)Seiji Noro
 

What's hot (9)

5 things for immediate impact on increasing SharePoint adoption
5 things for immediate impact on increasing SharePoint adoption5 things for immediate impact on increasing SharePoint adoption
5 things for immediate impact on increasing SharePoint adoption
 
A Business Perspective on Building SharePoint 2013 Solutions on Windows Azure
A Business Perspective on Building SharePoint 2013 Solutions on Windows AzureA Business Perspective on Building SharePoint 2013 Solutions on Windows Azure
A Business Perspective on Building SharePoint 2013 Solutions on Windows Azure
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine Learning
 
SPBiz - Practical Advice for developing your SharePoint Roadmap
SPBiz - Practical Advice for developing your SharePoint RoadmapSPBiz - Practical Advice for developing your SharePoint Roadmap
SPBiz - Practical Advice for developing your SharePoint Roadmap
 
MN Govt IT Symposium - SharePoint 2013 The Next Stage In Evolution
MN Govt IT Symposium - SharePoint 2013 The Next Stage In EvolutionMN Govt IT Symposium - SharePoint 2013 The Next Stage In Evolution
MN Govt IT Symposium - SharePoint 2013 The Next Stage In Evolution
 
The People's Innovation Platform - Microsoft Power Platform
    The People's Innovation Platform - Microsoft Power Platform    The People's Innovation Platform - Microsoft Power Platform
The People's Innovation Platform - Microsoft Power Platform
 
O365Con18 - New Era of Customizing - Olli Jaaskelainen
O365Con18 - New Era of Customizing - Olli JaaskelainenO365Con18 - New Era of Customizing - Olli Jaaskelainen
O365Con18 - New Era of Customizing - Olli Jaaskelainen
 
O365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
O365Con19 - Model-driven Apps or Canvas Apps? - Rick BakkerO365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
O365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
 
VJCD2017 SharePoint Framework (SPFx)
VJCD2017 SharePoint Framework (SPFx)VJCD2017 SharePoint Framework (SPFx)
VJCD2017 SharePoint Framework (SPFx)
 

Similar to The virtual assistant tour adelaide

Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Sam Fernando
 
Building Extensions in VSTS and TFS
Building Extensions in VSTS and TFSBuilding Extensions in VSTS and TFS
Building Extensions in VSTS and TFSJeff Bramwell
 
Building conversation AI using Azure Bot & LUIS
Building conversation AI using Azure Bot & LUISBuilding conversation AI using Azure Bot & LUIS
Building conversation AI using Azure Bot & LUISNitin Raj
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsHolzerKerstin
 
Getting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiGetting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiJasjit Chopra
 
Build a Great Conversationalist
Build a Great ConversationalistBuild a Great Conversationalist
Build a Great ConversationalistLorenzo Barbieri
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureMarco Parenzan
 
Microsoft Azure News - Sept 2016
Microsoft Azure News - Sept 2016Microsoft Azure News - Sept 2016
Microsoft Azure News - Sept 2016Daniel Toomey
 
Chatbot technology- The innovative enterprise collaboration
Chatbot technology- The innovative enterprise collaborationChatbot technology- The innovative enterprise collaboration
Chatbot technology- The innovative enterprise collaborationKushan Lahiru Perera
 
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...Vincent Biret
 
SPS Zurich 2018 - Azure Logic Apps: the new workflow engine
SPS Zurich 2018 - Azure Logic Apps: the new workflow engineSPS Zurich 2018 - Azure Logic Apps: the new workflow engine
SPS Zurich 2018 - Azure Logic Apps: the new workflow engineDavid Schneider
 
2018 07 aws windsor user group - fall project planning v1
2018 07 aws windsor user group - fall project planning v12018 07 aws windsor user group - fall project planning v1
2018 07 aws windsor user group - fall project planning v1Paul Camilleri, PMP
 
Adminstering biztalkusingchatbot
Adminstering biztalkusingchatbotAdminstering biztalkusingchatbot
Adminstering biztalkusingchatbotBizTalk360
 
Azure cloud for the web frontend developers
Azure cloud for the web frontend developersAzure cloud for the web frontend developers
Azure cloud for the web frontend developersMaxim Salnikov
 
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...Vincent Biret
 
The Atlassian Tool Suite for Collaborative Science
The Atlassian Tool Suite for Collaborative ScienceThe Atlassian Tool Suite for Collaborative Science
The Atlassian Tool Suite for Collaborative ScienceRajbahadur Rajput
 
How to build a serverless helmet detection system
How to build a serverless helmet detection systemHow to build a serverless helmet detection system
How to build a serverless helmet detection systemMandar Dharmadhikari
 
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...Sébastien Levert
 

Similar to The virtual assistant tour adelaide (20)

Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
 
Building Extensions in VSTS and TFS
Building Extensions in VSTS and TFSBuilding Extensions in VSTS and TFS
Building Extensions in VSTS and TFS
 
LUIS and Bots
LUIS and BotsLUIS and Bots
LUIS and Bots
 
Building conversation AI using Azure Bot & LUIS
Building conversation AI using Azure Bot & LUISBuilding conversation AI using Azure Bot & LUIS
Building conversation AI using Azure Bot & LUIS
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + Bots
 
Getting started with microsoft cognitive services api
Getting started with microsoft cognitive services apiGetting started with microsoft cognitive services api
Getting started with microsoft cognitive services api
 
Build a Great Conversationalist
Build a Great ConversationalistBuild a Great Conversationalist
Build a Great Conversationalist
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft Azure
 
Microsoft Azure News - Sept 2016
Microsoft Azure News - Sept 2016Microsoft Azure News - Sept 2016
Microsoft Azure News - Sept 2016
 
Chatbot technology- The innovative enterprise collaboration
Chatbot technology- The innovative enterprise collaborationChatbot technology- The innovative enterprise collaboration
Chatbot technology- The innovative enterprise collaboration
 
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...
#SPFestSea azr302 The SharePoint Framework and the #MicrosoftGraph under ster...
 
SPS Zurich 2018 - Azure Logic Apps: the new workflow engine
SPS Zurich 2018 - Azure Logic Apps: the new workflow engineSPS Zurich 2018 - Azure Logic Apps: the new workflow engine
SPS Zurich 2018 - Azure Logic Apps: the new workflow engine
 
2018 07 aws windsor user group - fall project planning v1
2018 07 aws windsor user group - fall project planning v12018 07 aws windsor user group - fall project planning v1
2018 07 aws windsor user group - fall project planning v1
 
Adminstering biztalkusingchatbot
Adminstering biztalkusingchatbotAdminstering biztalkusingchatbot
Adminstering biztalkusingchatbot
 
Azure cloud for the web frontend developers
Azure cloud for the web frontend developersAzure cloud for the web frontend developers
Azure cloud for the web frontend developers
 
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...
#SPSHouston Automating your digital workplace proivisioning with #Azure Durab...
 
The Atlassian Tool Suite for Collaborative Science
The Atlassian Tool Suite for Collaborative ScienceThe Atlassian Tool Suite for Collaborative Science
The Atlassian Tool Suite for Collaborative Science
 
How to build a serverless helmet detection system
How to build a serverless helmet detection systemHow to build a serverless helmet detection system
How to build a serverless helmet detection system
 
Webinar azuretalk
Webinar azuretalkWebinar azuretalk
Webinar azuretalk
 
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...
SharePoint Saturday Cape Town - Introduction to AngularJS with the Microsoft ...
 

Recently uploaded

The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 

Recently uploaded (20)

The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 

The virtual assistant tour adelaide

  • 1. THE VIRTUAL ASSISTANT TOUR HI, I M YOUR CORTANA Asish Padhy @AsishPadhy
  • 2. HELLO, HOLA, NAMASTE, NI HAO… • Tech Lover and Enthusiast • 14+ years of building solutions • Architect and Developer in M365, Azure, AI and lot many ... @AsishPadhy
  • 3. AGENDA • Microsoft Teams and Bots • Virtual Assistant Intro • What it means for organization • Components & Template • Design Flow • Demo • Skills • Use Cases and Things to know @AsishPadhy
  • 4. MICROSOFT TEAMS AND BOTS • Teams acts as hosting interface for Bots • Bots are code running in Azure App Service and listening to Team events • Bots use multiple Azure Cognitive Services such as • LUIS • QNA Maker • Image • Speech • Responses from Bots are fed back using Channels such as Teams App @AsishPadhy
  • 5. VIRTUAL ASSISTANT • Cumulative Bots Experience tailored to your brand • Conversational Assistant across broad range of applications • Personalized to Users and brand • Extensible with Skills • Provides a great starting point with Templates @AsishPadhy
  • 6. VIRTUAL ASSISTANT @AsishPadhy Business Ownership Custom Abilities o Create own knowledge base o Get information specific to particular business requirements o Create a map of existing data with the business need o Owned Processes o Add skills / abilities as per your business requirement o Provide more skillful actions for user actions such as automated prompts, activity tracking etc. o Create a custom flow that works with your business processes o Experience and build value o Start with an existing template build on Microsoft experiences o Focusses on combination of services and strength of using each o Build and extend as you go Starting Point
  • 7. o New or existing bots o Extensible o Programmable VIRTUAL ASSISTANT TOUR @AsishPadhy o Access Points o E.g. Teams, Emails, Web, Speech o Document Repositories o Line of Business databases o CRM and Employee Systems o Offload complexity and intelligence o LUIS, QNA Maker, Azure Search
  • 8. VIRTUAL ASSISTANT @AsishPadhy Content Moderator Telemetry Virtual Assistant Dispatch LUIS QnA Skills Bot Skill 1 Bot Skill 2 • Focus on Routing requests • Core scalability with Dispatch tool • Support for Telemetry (analytics) • Support for Content Moderation • Core support from LUIS and QnA services • Extensibility with Skills with existing bot functionalities
  • 9. VIRTUAL ASSISTANT FLOW @AsishPadhy •Knowledge Sources •Channels •User Inputs •Skills Define •Virtual Assistant •QNA Maker •Custom Skills Build •Azure Hosting •Channel Hosting •AI Hosting Deploy
  • 10. DEMO I AM YOUR CORTANA @AsishPadhy
  • 11. • Provide a way to expand on available or new conversational or AI abilities • Addons at Organizational scope • Skills allows to reuse existing conversational features • Some startup template skills provided by Microsoft • E.g. • Email Skill • Todo Skill • Calendar Skill SKILLS @AsishPadhy
  • 12. CUSTOM SKILLS • Provided Skill template as a starting point • Extend an existing custom bot to skill • Add the skill to virtual assistant using botskills command • Update the dispatch skill in assistant • Support Authentication • Available Skills CLI tool @AsishPadhy
  • 13. USE CASES • Single routing interface for multiple bot scenarios • Automated learning platform with extension to multiple channels •E.g. • Customer Service Request • Planner and Organizer • Go to Help / Support Request @AsishPadhy
  • 14. @AsishPadhy THINGS TO KNOW  Update Template.json to customize the virtual assistant azure resources deployment  Quickly train QnA and LUIS using LU files in Resources folder under Deployment  Activate LUIS and assign authoring key to prevent service drops  Identify load and plan cost for Azure Search RPUs  Update Skills dialog for custom prompts and flow  Deploy the skill to Virtual Assistant after complete individual testing using bot emulator  Don’t make skill too specific or heavy. Keep it light and scalable  Create more granular independent skills  Use Direct line Speech for easy accessibility
  • 15. @AsishPadhy HELP Skills Virtual assistant Sample Skills Repo (C#) Create Virtual Assistant Create Skill https://docs.microsoft.com/en-us/azure/bot-service/bot- builder-skills-overview?view=azure-bot-service-4.0 https://docs.microsoft.com/en-us/azure/bot-service/bot-builder- virtual-assistant-introduction?view=azure-bot-service-4.0 https://github.com/microsoft/botframework- solutions/tree/master/skills/csharp https://microsoft.github.io/botframework-solutions/virtual- assistant/tutorials/create-assistant/csharp/1-intro/ https://microsoft.github.io/botframework- solutions/skills/tutorials/create-skill/csharp/1-intro/