SlideShare a Scribd company logo
1 of 48
Download to read offline
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SVR304
bots + serverless =
Vishal Singh, Senior Product Manager,
AWS Lambda
December 1, 2016
What to Expect from the Session
• Introduction to Serverless Chatbots
• Frameworks and integrations for serverless chatbots
• AWS Slack chatbot hackathon summary
• Amazon Lex
• Architecture & benefits
• Demo – building a Facebook chatbot using Lex + Lambda
• Mobile Hub enterprise SaaS connectors
Introduction to Serverless
Chatbots
Chatbots
Chatbot is a service designed to simulate conversation with
human users, accessible from a messaging interface.
Key characteristics:
On-demand
Accessible
Efficient
Natural
AWS Lambda: Run code in response to events
COMPUTE
SERVICE
EVENT
DRIVEN
Run arbitrary
code without
managing
servers
Code only runs
when it needs to
run
Code is all you need Event-driven scaling
Never pay for idle Availability and fault tolerance built in
Benefits of AWS Lambda
Amazon API Gateway: Serverless APIs
Internet
Mobile apps
Websites
Services
AWS Lambda
functions
AWS
API Gateway
cache
Endpoints on
Amazon EC2
Any other publicly
accessible endpointAmazon
CloudWatch
Amazon
CloudFront
Amazon
API Gateway
Benefits of Amazon API Gateway
Create a unified API
frontend for multiple
microservices
DDoS protection
and throttling for
your back end
Authenticate and
authorize requests
to a back end
Serverless Apps
EVENT SOURCE FUNCTION SERVICES (ANYTHING)
Changes in
data state
Requests to
endpoints
Changes in
resource state
Node
Python
Java
C# NEW!
The Serverless Chatbot
Internet
Any
Messaging
app
AWS Lambda
functions
AWS
API Gateway Other AWS
services
Any other publicly
accessible endpoint
Webhook using API Gateway & AWS Lambda
Things to Note
Intent resolution: Language understanding is handled by
the Lambda function using NLP libraries
Authentication: API Gateway authenticates the incoming
requests before passing to Lambda.
Partner integrations:
• Slack (blueprints available!)
• Twilio
• Hipchat
Building Chatbots with Serverless
1.Upload Bot code to AWS
Lambda
2.Set code to trigger when user
interacts via API Gateway
webhook
3.Integrate with Messaging
service
4.Test your chatbots
Frameworks and Integrations
for Chatbots
Frameworks and Integrations for Serverless
Chatbots
AWS SAM – AWS Serverless Application Model
• Specification to express a serverless chatbot application
• Helps in quickly deploying your application via
CloudFormation
Other community frameworks:
• Claudia-bot-builder – Node open source framework
• Serverless.com – Serverless framework
NEW !
+ NEW !
NEW !
AWS Slack Chatbot Hackathon
Summary
AWS Slack Chatbot Hackathon Summary
• 2 months virtual
hackathon
(Aug10–Sept29 ‘16)
• 650+ registrations
• ~70 submissions
• Using various
frameworks,
libraries, open
source and more
https://awschatbot.devpost.com/submissions
Hackathon Popular Chatbot Use Cases
• ChatOps
• Education
• Social
• Translation
• Travel
• Trivia
• Polls/quiz
• Knowledge Base
• Many more…
AWS Slack Hackathon Winners -
Congratulations!
Chatbots Architectural Recommendations
• Authentication and authorization
• Sigv4, Amazon Cognito, custom authorizers
• Lambda execution role
• Environment variables
• Encrypt your secrets
• Persistence of state & sessions
• DDB, S3, or any data store
• Reuse bot logic across messaging platforms
NEW !
Developer Challenges
Conversational interfaces need to combine a large number of
sophisticated algorithms and technologies
Business Logic
Disparate
Systems
AuthenticationSpeech
Recognition Language
Understanding
Messaging
Platforms
Scale Testing
Security
Availability
Mobile
Amazon Lex
Amazon Lex Features
Text and speech language understanding: powered by the same technology as
Alexa
Enterprise SaaS connectors: connect to enterprise systems
Deployment to chat services
Designed for builders: efficient and intuitive tools to build
conversations; scales automatically
Versioning and alias support
@
Text and Speech Language Understanding
Speech
Recognition
Natural Language
Understanding
Powered by the same Deep Learning technology as Alexa
Deployment to Chat Services
Facebook
Messenger
Mobile
Card Description
Button 1
Button 2
Button 3
Card
Description
Option 1
Option 2
Authentication
Rich FormattingOne-Click Deployment
Amazon Lex
Designed for Builders
Efficient and intuitive tools to build conversations
Versioning and Alias Support
AliasVersioning
• Supported for Intents, Slots, and Bots
• Enables multi-developer environment
• Roll back to previous versions
• Deploy different aliases to different platforms
• Run different stacks for dev, stage, and prod environments
• Target different user groups with different aliases
v1 v2 v3 latest
v1 Dev
v2 Stage
v3 Prod
Lex Bot Structure
Utterances
Spoken or typed phrases that invoke
your intent
BookHotel
Intents
An intent performs an action in
response to natural language user
input
Slots
Slots are input data required to fulfill
the intent
Fulfillment
Fulfillment mechanism for your intent
Utterances
I’d like to book a hotel
I want to make my hotel reservations
I want to book a hotel in New York City
Can you help me book my hotel?
Slots
destination City New York City, Seattle, London, …
Slot Type Values
Check In Date Valid dates
Check Out Date Valid dates
Slot Elicitation
I’d like to book a hotel
What date do you check in?
New York City
Sure what city do you want to book?
Nov 30th Check In
11/30/2016
City
New York City
Fulfillment
AWS Lambda
Integration
Return to
Client
User input parsed to derive
intents and slot values.
Output returned to client for
further processing.
Intents and slots passed to
AWS Lambda function for
business logic
implementation.
“Book a Hotel”
Book Hotel
NYC
“Book a Hotel in
NYC”
Hotel Booking
New York City
Natural Language
Understanding
Intent/Slot
Model
UtterancesHotel Booking
City New York City
Check In Nov 30th
Check Out Dec 2nd
“Your hotel is booked for
Nov 30th”
Confirmation: “Your hotel
is booked for Nov 30th”
“Can I go ahead
with the booking?
a
in
User
interacts with
Chabot
Confirmation
Save, Build, and Publish
Save Build
Saving your bot
preserves the current
state on the server
Building your bot
creates versions
that you can test.
Publish
Publishing your app will create a
version of your bot and provide
an alias to your clients
Test
Test your bot in a
chat window on the
Console
Monitoring
Track your bot
Request Latency
Missed Utterance Count
Amazon Lex Technology
Amazon Lex
Automatic Speech
Recognition (ASR)
Natural Language
Understanding (NLU)
Same technology that powers Alexa
Amazon Cognito CloudTrail CloudWatch
AWS Services
Action
AWS Lambda
Authentication
& Visibility
Speech
API
Language
API
Fulfillment
End Users
Developers
Console
SDK
Intents,
Slots,
Prompts,
Utterances
Speech or
Text Input
Multi-Platform Clients:
Mobile, IoT, Web,
Chat
API
Demo
Build a FB “Moviepedia” chatbot using Lex + Lambda
Amazon Lex Use Cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Amazon Lex Benefits
High quality text and speech language
understanding
Built-in integration with the AWS platform
Seamlessly deploy and scale
Easy to use
Cost-effective
Mobile Hub + Enterprise SaaS
Connectors
AWS Mobile Hub Integration
Authenticate users
Analyze user behavior
Store and share media
Synchronize data
More ….
Track retention
Conversational Bots
LexAWS Mobile SDKs
AWS Mobile Hub
Enterprise SaaS Connectors with Mobile Hub
Mobile Hub
SaaS Connector
Amazon API
Gateway
AWS
Lambda
Amazon API
Gateway
AWS
Lambda
Mobile Hub
Custom Connector
Mobile App Amazon Lex
AWS
Lambda
Business
Application
Firewall
Enterprise SaaS Connectors with Mobile Hub
Amazon Lex
Mobile App
Mobile Hub
SaaS Connector
Amazon API
Gateway
AWS
Lambda
1: Understand
user intent
Amazon API
Gateway
AWS
Lambda
3: Translate
REST response
into natural
language
Mobile Hub
Custom Connector
2: Invoke a SaaS
application or an existing
business application
Business
Application
Firewall
User Input
Recap
• First, we looked into creating chatbots as serverless
webhooks using AWS Lambda and API Gateway
• Next, we added natural language intelligence to your
chatbots using Amazon Lex and AWS Lambda
• Finally, we looked at mobile hub integration and
enterprise SaaS connectors to enrich your chatbot with
enterprise data
Key Takeaway: Register for the Preview @
aws.amazon.com/lex
Sign-Up & Whitelist
Build your first serverless chatbot using samples in
Lex and Lambda blueprints!
✔
✔
✔
Thank you!
Remember to complete
your evaluations!

More Related Content

What's hot

What's hot (20)

應用程式迅速開發與串連廣大用戶要素
應用程式迅速開發與串連廣大用戶要素應用程式迅速開發與串連廣大用戶要素
應用程式迅速開發與串連廣大用戶要素
 
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
New Artificial Intelligence and IoT Services (Lex, Polly, Rekognition, Greeng...
 
Building Secure Mobile APIs
Building Secure Mobile APIsBuilding Secure Mobile APIs
Building Secure Mobile APIs
 
Introduzione ad Amazon Lex
Introduzione ad Amazon LexIntroduzione ad Amazon Lex
Introduzione ad Amazon Lex
 
Developing Applications with the IoT Button - DevDay Los Angeles 2017
Developing Applications with the IoT Button - DevDay Los Angeles 2017Developing Applications with the IoT Button - DevDay Los Angeles 2017
Developing Applications with the IoT Button - DevDay Los Angeles 2017
 
Getting Started with AWS IoT
Getting Started with AWS IoTGetting Started with AWS IoT
Getting Started with AWS IoT
 
AWS Mobile Hub
AWS Mobile HubAWS Mobile Hub
AWS Mobile Hub
 
NEW LAUNCH! Enhance Your Mobile Apps with AI Using Amazon Lex
NEW LAUNCH! Enhance Your Mobile Apps with AI Using Amazon LexNEW LAUNCH! Enhance Your Mobile Apps with AI Using Amazon Lex
NEW LAUNCH! Enhance Your Mobile Apps with AI Using Amazon Lex
 
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
 
Develping mobile services on aws - Pop-up Loft Tel Aviv
Develping mobile services on aws - Pop-up Loft Tel AvivDevelping mobile services on aws - Pop-up Loft Tel Aviv
Develping mobile services on aws - Pop-up Loft Tel Aviv
 
Mobile Applications and The Internet of Things: AWS Lambda & AWS Cognito – Ad...
Mobile Applications and The Internet of Things: AWS Lambda & AWS Cognito – Ad...Mobile Applications and The Internet of Things: AWS Lambda & AWS Cognito – Ad...
Mobile Applications and The Internet of Things: AWS Lambda & AWS Cognito – Ad...
 
Continuous Integration e Delivery per (r)innovare lo sviluppo software e la g...
Continuous Integration e Delivery per (r)innovare lo sviluppo software e la g...Continuous Integration e Delivery per (r)innovare lo sviluppo software e la g...
Continuous Integration e Delivery per (r)innovare lo sviluppo software e la g...
 
Build high performing mobile apps, faster with AWS
Build high performing mobile apps, faster with AWSBuild high performing mobile apps, faster with AWS
Build high performing mobile apps, faster with AWS
 
Connecting to AWS IoT
Connecting to AWS IoTConnecting to AWS IoT
Connecting to AWS IoT
 
One Click Enterprise IoT Services - March 2017 AWS Online Tech Talks
One Click Enterprise IoT Services - March 2017 AWS Online Tech TalksOne Click Enterprise IoT Services - March 2017 AWS Online Tech Talks
One Click Enterprise IoT Services - March 2017 AWS Online Tech Talks
 
AWS re:Invent 2016: 1-Click Enterprise Innovation with the AWS IoT Button (IO...
AWS re:Invent 2016: 1-Click Enterprise Innovation with the AWS IoT Button (IO...AWS re:Invent 2016: 1-Click Enterprise Innovation with the AWS IoT Button (IO...
AWS re:Invent 2016: 1-Click Enterprise Innovation with the AWS IoT Button (IO...
 
(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood
 
AWS September Webinar Series - Build Cross-Platform Mobile Apps with AWS and...
AWS September Webinar Series -  Build Cross-Platform Mobile Apps with AWS and...AWS September Webinar Series -  Build Cross-Platform Mobile Apps with AWS and...
AWS September Webinar Series - Build Cross-Platform Mobile Apps with AWS and...
 
AWS re:Invent 2016: Robots: The Fading Line Between Real and Virtual Worlds (...
AWS re:Invent 2016: Robots: The Fading Line Between Real and Virtual Worlds (...AWS re:Invent 2016: Robots: The Fading Line Between Real and Virtual Worlds (...
AWS re:Invent 2016: Robots: The Fading Line Between Real and Virtual Worlds (...
 
Deep Dive on Amazon Cognito - DevDay Los Angeles 2017
Deep Dive on Amazon Cognito - DevDay Los Angeles 2017Deep Dive on Amazon Cognito - DevDay Los Angeles 2017
Deep Dive on Amazon Cognito - DevDay Los Angeles 2017
 

Viewers also liked

Viewers also liked (20)

AWS re:Invent 2016: Workshop: Building Serverless Bots on AWS - Botathon (DCS...
AWS re:Invent 2016: Workshop: Building Serverless Bots on AWS - Botathon (DCS...AWS re:Invent 2016: Workshop: Building Serverless Bots on AWS - Botathon (DCS...
AWS re:Invent 2016: Workshop: Building Serverless Bots on AWS - Botathon (DCS...
 
AWS re:Invent 2016: What’s New with AWS Lambda (SVR202)
AWS re:Invent 2016: What’s New with AWS Lambda (SVR202)AWS re:Invent 2016: What’s New with AWS Lambda (SVR202)
AWS re:Invent 2016: What’s New with AWS Lambda (SVR202)
 
AWS re:Invent 2016: The State of Serverless Computing (SVR311)
AWS re:Invent 2016: The State of Serverless Computing (SVR311)AWS re:Invent 2016: The State of Serverless Computing (SVR311)
AWS re:Invent 2016: The State of Serverless Computing (SVR311)
 
AWS re:Invent 2016: All Your Chats are Belong to Bots: Building a Serverless ...
AWS re:Invent 2016: All Your Chats are Belong to Bots: Building a Serverless ...AWS re:Invent 2016: All Your Chats are Belong to Bots: Building a Serverless ...
AWS re:Invent 2016: All Your Chats are Belong to Bots: Building a Serverless ...
 
AWS re:Invent 2016: ↑↑↓↓←→←→ BA Lambda Start (SVR305)
AWS re:Invent 2016: ↑↑↓↓←→←→ BA Lambda Start (SVR305)AWS re:Invent 2016: ↑↑↓↓←→←→ BA Lambda Start (SVR305)
AWS re:Invent 2016: ↑↑↓↓←→←→ BA Lambda Start (SVR305)
 
AWS re:Invent 2016: Serverless Computing Patterns at Expedia (SVR306) )
AWS re:Invent 2016: Serverless Computing Patterns at Expedia (SVR306) )AWS re:Invent 2016: Serverless Computing Patterns at Expedia (SVR306) )
AWS re:Invent 2016: Serverless Computing Patterns at Expedia (SVR306) )
 
AWS re:Invent 2016: Application Lifecycle Management in a Serverless World (S...
AWS re:Invent 2016: Application Lifecycle Management in a Serverless World (S...AWS re:Invent 2016: Application Lifecycle Management in a Serverless World (S...
AWS re:Invent 2016: Application Lifecycle Management in a Serverless World (S...
 
NEW LAUNCH! Serverless Apps with AWS Step Functions
NEW LAUNCH! Serverless Apps with AWS Step FunctionsNEW LAUNCH! Serverless Apps with AWS Step Functions
NEW LAUNCH! Serverless Apps with AWS Step Functions
 
AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)
AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)
AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)
 
AI Agent and Chatbot Trends For Enterprises
AI Agent and Chatbot Trends For EnterprisesAI Agent and Chatbot Trends For Enterprises
AI Agent and Chatbot Trends For Enterprises
 
How to form a team for Venturesity Hackathons
How to form a team for Venturesity HackathonsHow to form a team for Venturesity Hackathons
How to form a team for Venturesity Hackathons
 
AWS ML and SparkML on EMR to Build Recommendation Engine
AWS ML and SparkML on EMR to Build Recommendation Engine AWS ML and SparkML on EMR to Build Recommendation Engine
AWS ML and SparkML on EMR to Build Recommendation Engine
 
AWS re:Invent 2016: Moving Mountains: Netflix's Migration into VPC (NET304)
AWS re:Invent 2016: Moving Mountains: Netflix's Migration into VPC (NET304)AWS re:Invent 2016: Moving Mountains: Netflix's Migration into VPC (NET304)
AWS re:Invent 2016: Moving Mountains: Netflix's Migration into VPC (NET304)
 
AWS re:Invent 2016: The Psychology of Security Automation (SAC307)
AWS re:Invent 2016: The Psychology of Security Automation (SAC307)AWS re:Invent 2016: The Psychology of Security Automation (SAC307)
AWS re:Invent 2016: The Psychology of Security Automation (SAC307)
 
AWS re:Invent 2016: NEW LAUNCH! Workshop: Hands on with Amazon Lex, Amazon Po...
AWS re:Invent 2016: NEW LAUNCH! Workshop: Hands on with Amazon Lex, Amazon Po...AWS re:Invent 2016: NEW LAUNCH! Workshop: Hands on with Amazon Lex, Amazon Po...
AWS re:Invent 2016: NEW LAUNCH! Workshop: Hands on with Amazon Lex, Amazon Po...
 
Announcing AWS Personal Health Dashboard - January 2017 AWS Online Tech Talks
Announcing AWS Personal Health Dashboard - January 2017 AWS Online Tech TalksAnnouncing AWS Personal Health Dashboard - January 2017 AWS Online Tech Talks
Announcing AWS Personal Health Dashboard - January 2017 AWS Online Tech Talks
 
AWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless CloudAWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless Cloud
 
AWS re:Invent 2016: [JK REPEAT] Serverless Architectural Patterns and Best Pr...
AWS re:Invent 2016: [JK REPEAT] Serverless Architectural Patterns and Best Pr...AWS re:Invent 2016: [JK REPEAT] Serverless Architectural Patterns and Best Pr...
AWS re:Invent 2016: [JK REPEAT] Serverless Architectural Patterns and Best Pr...
 
NEW LAUNCH! Building Distributed Applications with AWS Step Functions
NEW LAUNCH! Building Distributed Applications with AWS Step FunctionsNEW LAUNCH! Building Distributed Applications with AWS Step Functions
NEW LAUNCH! Building Distributed Applications with AWS Step Functions
 
AWS re:Invent 2016: Deep Dive on Amazon DynamoDB (DAT304)
AWS re:Invent 2016: Deep Dive on Amazon DynamoDB (DAT304)AWS re:Invent 2016: Deep Dive on Amazon DynamoDB (DAT304)
AWS re:Invent 2016: Deep Dive on Amazon DynamoDB (DAT304)
 

Similar to AWS re:Invent 2016: bots + serverless = ❤ (SVR304)

Similar to AWS re:Invent 2016: bots + serverless = ❤ (SVR304) (20)

Introducing Amazon Lex
Introducing Amazon Lex Introducing Amazon Lex
Introducing Amazon Lex
 
Building ChatBots with Amazon Lex - AWS Summit Tel Aviv 2017
Building ChatBots with Amazon Lex - AWS Summit Tel Aviv 2017Building ChatBots with Amazon Lex - AWS Summit Tel Aviv 2017
Building ChatBots with Amazon Lex - AWS Summit Tel Aviv 2017
 
Building a Better .NET Bot with AWS Services - WIN205 - re:Invent 2017
Building a Better .NET Bot with AWS Services - WIN205 - re:Invent 2017Building a Better .NET Bot with AWS Services - WIN205 - re:Invent 2017
Building a Better .NET Bot with AWS Services - WIN205 - re:Invent 2017
 
WIN205-Building a Better .NET Bot with AWS Services
WIN205-Building a Better .NET Bot with AWS ServicesWIN205-Building a Better .NET Bot with AWS Services
WIN205-Building a Better .NET Bot with AWS Services
 
Deep Dive: Amazon Lex
Deep Dive: Amazon LexDeep Dive: Amazon Lex
Deep Dive: Amazon Lex
 
Building a Chatbot with Amazon Lex and AWS Lambda Workshop
Building a Chatbot with Amazon Lex and AWS Lambda WorkshopBuilding a Chatbot with Amazon Lex and AWS Lambda Workshop
Building a Chatbot with Amazon Lex and AWS Lambda Workshop
 
Announcing Amazon Lex - January 2017 AWS Online Tech Talks
Announcing Amazon Lex - January 2017 AWS Online Tech TalksAnnouncing Amazon Lex - January 2017 AWS Online Tech Talks
Announcing Amazon Lex - January 2017 AWS Online Tech Talks
 
使用 Amazon Lex 在應用程式中建立對話式機器人
使用 Amazon Lex 在應用程式中建立對話式機器人 使用 Amazon Lex 在應用程式中建立對話式機器人
使用 Amazon Lex 在應用程式中建立對話式機器人
 
Building voice enabled Apps with Alexa voice service and Amazon Lex.
Building voice enabled Apps with Alexa voice service and Amazon Lex.     Building voice enabled Apps with Alexa voice service and Amazon Lex.
Building voice enabled Apps with Alexa voice service and Amazon Lex.
 
Introducing Amazon Lex – Service for Building Voice or Text Chatbots
Introducing Amazon Lex – Service for Building Voice or Text ChatbotsIntroducing Amazon Lex – Service for Building Voice or Text Chatbots
Introducing Amazon Lex – Service for Building Voice or Text Chatbots
 
Build a Great Conversationalist
Build a Great ConversationalistBuild a Great Conversationalist
Build a Great Conversationalist
 
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Lex (MAC304)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Lex (MAC304)AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Lex (MAC304)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Lex (MAC304)
 
Building Serverless Chat Bots - AWS August Webinar Series
Building Serverless Chat Bots - AWS August Webinar SeriesBuilding Serverless Chat Bots - AWS August Webinar Series
Building Serverless Chat Bots - AWS August Webinar Series
 
Getting Started with Amazon Lex - AWS Summit Cape Town 2017
Getting Started with Amazon Lex  - AWS Summit Cape Town 2017 Getting Started with Amazon Lex  - AWS Summit Cape Town 2017
Getting Started with Amazon Lex - AWS Summit Cape Town 2017
 
AWS_For_Girls_Amazon_Lex.pptx
AWS_For_Girls_Amazon_Lex.pptxAWS_For_Girls_Amazon_Lex.pptx
AWS_For_Girls_Amazon_Lex.pptx
 
Building Chatbots with Amazon Lex I AWS Dev Day 2018
Building Chatbots with Amazon Lex I AWS Dev Day 2018Building Chatbots with Amazon Lex I AWS Dev Day 2018
Building Chatbots with Amazon Lex I AWS Dev Day 2018
 
Serve Your Customers with AI from the Cloud: AWS Developer Workshop - Web Sum...
Serve Your Customers with AI from the Cloud: AWS Developer Workshop - Web Sum...Serve Your Customers with AI from the Cloud: AWS Developer Workshop - Web Sum...
Serve Your Customers with AI from the Cloud: AWS Developer Workshop - Web Sum...
 
Zombie Apocalypse Workshop by Warren Santer and Kyle Somers, Solutions Archit...
Zombie Apocalypse Workshop by Warren Santer and Kyle Somers, Solutions Archit...Zombie Apocalypse Workshop by Warren Santer and Kyle Somers, Solutions Archit...
Zombie Apocalypse Workshop by Warren Santer and Kyle Somers, Solutions Archit...
 
Introduction to Microsoft Azure App Service (Logic and API Apps)
Introduction to Microsoft Azure App Service (Logic and API Apps)Introduction to Microsoft Azure App Service (Logic and API Apps)
Introduction to Microsoft Azure App Service (Logic and API Apps)
 
Getting Started with Serverless Architectures - August 2016 Monthly Webinar S...
Getting Started with Serverless Architectures - August 2016 Monthly Webinar S...Getting Started with Serverless Architectures - August 2016 Monthly Webinar S...
Getting Started with Serverless Architectures - August 2016 Monthly Webinar S...
 

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Recently uploaded

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 

Recently uploaded (20)

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAK
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 

AWS re:Invent 2016: bots + serverless = ❤ (SVR304)

  • 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SVR304 bots + serverless = Vishal Singh, Senior Product Manager, AWS Lambda December 1, 2016
  • 2. What to Expect from the Session • Introduction to Serverless Chatbots • Frameworks and integrations for serverless chatbots • AWS Slack chatbot hackathon summary • Amazon Lex • Architecture & benefits • Demo – building a Facebook chatbot using Lex + Lambda • Mobile Hub enterprise SaaS connectors
  • 4. Chatbots Chatbot is a service designed to simulate conversation with human users, accessible from a messaging interface. Key characteristics: On-demand Accessible Efficient Natural
  • 5. AWS Lambda: Run code in response to events COMPUTE SERVICE EVENT DRIVEN Run arbitrary code without managing servers Code only runs when it needs to run
  • 6. Code is all you need Event-driven scaling Never pay for idle Availability and fault tolerance built in Benefits of AWS Lambda
  • 7. Amazon API Gateway: Serverless APIs Internet Mobile apps Websites Services AWS Lambda functions AWS API Gateway cache Endpoints on Amazon EC2 Any other publicly accessible endpointAmazon CloudWatch Amazon CloudFront Amazon API Gateway
  • 8. Benefits of Amazon API Gateway Create a unified API frontend for multiple microservices DDoS protection and throttling for your back end Authenticate and authorize requests to a back end
  • 9. Serverless Apps EVENT SOURCE FUNCTION SERVICES (ANYTHING) Changes in data state Requests to endpoints Changes in resource state Node Python Java C# NEW!
  • 10. The Serverless Chatbot Internet Any Messaging app AWS Lambda functions AWS API Gateway Other AWS services Any other publicly accessible endpoint Webhook using API Gateway & AWS Lambda
  • 11. Things to Note Intent resolution: Language understanding is handled by the Lambda function using NLP libraries Authentication: API Gateway authenticates the incoming requests before passing to Lambda. Partner integrations: • Slack (blueprints available!) • Twilio • Hipchat
  • 12. Building Chatbots with Serverless 1.Upload Bot code to AWS Lambda 2.Set code to trigger when user interacts via API Gateway webhook 3.Integrate with Messaging service 4.Test your chatbots
  • 14. Frameworks and Integrations for Serverless Chatbots AWS SAM – AWS Serverless Application Model • Specification to express a serverless chatbot application • Helps in quickly deploying your application via CloudFormation Other community frameworks: • Claudia-bot-builder – Node open source framework • Serverless.com – Serverless framework NEW !
  • 16. AWS Slack Chatbot Hackathon Summary
  • 17. AWS Slack Chatbot Hackathon Summary • 2 months virtual hackathon (Aug10–Sept29 ‘16) • 650+ registrations • ~70 submissions • Using various frameworks, libraries, open source and more https://awschatbot.devpost.com/submissions
  • 18. Hackathon Popular Chatbot Use Cases • ChatOps • Education • Social • Translation • Travel • Trivia • Polls/quiz • Knowledge Base • Many more…
  • 19. AWS Slack Hackathon Winners - Congratulations!
  • 20. Chatbots Architectural Recommendations • Authentication and authorization • Sigv4, Amazon Cognito, custom authorizers • Lambda execution role • Environment variables • Encrypt your secrets • Persistence of state & sessions • DDB, S3, or any data store • Reuse bot logic across messaging platforms NEW !
  • 21. Developer Challenges Conversational interfaces need to combine a large number of sophisticated algorithms and technologies Business Logic Disparate Systems AuthenticationSpeech Recognition Language Understanding Messaging Platforms Scale Testing Security Availability Mobile
  • 23. Amazon Lex Features Text and speech language understanding: powered by the same technology as Alexa Enterprise SaaS connectors: connect to enterprise systems Deployment to chat services Designed for builders: efficient and intuitive tools to build conversations; scales automatically Versioning and alias support @
  • 24. Text and Speech Language Understanding Speech Recognition Natural Language Understanding Powered by the same Deep Learning technology as Alexa
  • 25. Deployment to Chat Services Facebook Messenger Mobile Card Description Button 1 Button 2 Button 3 Card Description Option 1 Option 2 Authentication Rich FormattingOne-Click Deployment Amazon Lex
  • 26. Designed for Builders Efficient and intuitive tools to build conversations
  • 27. Versioning and Alias Support AliasVersioning • Supported for Intents, Slots, and Bots • Enables multi-developer environment • Roll back to previous versions • Deploy different aliases to different platforms • Run different stacks for dev, stage, and prod environments • Target different user groups with different aliases v1 v2 v3 latest v1 Dev v2 Stage v3 Prod
  • 28. Lex Bot Structure Utterances Spoken or typed phrases that invoke your intent BookHotel Intents An intent performs an action in response to natural language user input Slots Slots are input data required to fulfill the intent Fulfillment Fulfillment mechanism for your intent
  • 29. Utterances I’d like to book a hotel I want to make my hotel reservations I want to book a hotel in New York City Can you help me book my hotel?
  • 30. Slots destination City New York City, Seattle, London, … Slot Type Values Check In Date Valid dates Check Out Date Valid dates
  • 31. Slot Elicitation I’d like to book a hotel What date do you check in? New York City Sure what city do you want to book? Nov 30th Check In 11/30/2016 City New York City
  • 32. Fulfillment AWS Lambda Integration Return to Client User input parsed to derive intents and slot values. Output returned to client for further processing. Intents and slots passed to AWS Lambda function for business logic implementation.
  • 33. “Book a Hotel” Book Hotel NYC “Book a Hotel in NYC” Hotel Booking New York City Natural Language Understanding Intent/Slot Model UtterancesHotel Booking City New York City Check In Nov 30th Check Out Dec 2nd “Your hotel is booked for Nov 30th” Confirmation: “Your hotel is booked for Nov 30th” “Can I go ahead with the booking? a in User interacts with Chabot Confirmation
  • 34. Save, Build, and Publish Save Build Saving your bot preserves the current state on the server Building your bot creates versions that you can test. Publish Publishing your app will create a version of your bot and provide an alias to your clients Test Test your bot in a chat window on the Console
  • 35. Monitoring Track your bot Request Latency Missed Utterance Count
  • 36. Amazon Lex Technology Amazon Lex Automatic Speech Recognition (ASR) Natural Language Understanding (NLU) Same technology that powers Alexa Amazon Cognito CloudTrail CloudWatch AWS Services Action AWS Lambda Authentication & Visibility Speech API Language API Fulfillment End Users Developers Console SDK Intents, Slots, Prompts, Utterances Speech or Text Input Multi-Platform Clients: Mobile, IoT, Web, Chat API
  • 37. Demo Build a FB “Moviepedia” chatbot using Lex + Lambda
  • 38.
  • 39. Amazon Lex Use Cases Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications • News updates • Weather information • Game scores …. • Book tickets • Order food • Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies • Check sales numbers • Marketing performance • Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions • Wearables • Appliances • Auto ….
  • 40. Amazon Lex Benefits High quality text and speech language understanding Built-in integration with the AWS platform Seamlessly deploy and scale Easy to use Cost-effective
  • 41. Mobile Hub + Enterprise SaaS Connectors
  • 42. AWS Mobile Hub Integration Authenticate users Analyze user behavior Store and share media Synchronize data More …. Track retention Conversational Bots LexAWS Mobile SDKs AWS Mobile Hub
  • 43. Enterprise SaaS Connectors with Mobile Hub Mobile Hub SaaS Connector Amazon API Gateway AWS Lambda Amazon API Gateway AWS Lambda Mobile Hub Custom Connector Mobile App Amazon Lex AWS Lambda Business Application Firewall
  • 44. Enterprise SaaS Connectors with Mobile Hub Amazon Lex Mobile App Mobile Hub SaaS Connector Amazon API Gateway AWS Lambda 1: Understand user intent Amazon API Gateway AWS Lambda 3: Translate REST response into natural language Mobile Hub Custom Connector 2: Invoke a SaaS application or an existing business application Business Application Firewall User Input
  • 45. Recap • First, we looked into creating chatbots as serverless webhooks using AWS Lambda and API Gateway • Next, we added natural language intelligence to your chatbots using Amazon Lex and AWS Lambda • Finally, we looked at mobile hub integration and enterprise SaaS connectors to enrich your chatbot with enterprise data
  • 46. Key Takeaway: Register for the Preview @ aws.amazon.com/lex Sign-Up & Whitelist Build your first serverless chatbot using samples in Lex and Lambda blueprints! ✔ ✔ ✔