Learn How to Build a Bot for Voice and Text with Amazon Lex and Amazon Polly

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Learn How to Build a Bot with Amazon Lex
and Amazon Polly

2. Rohan Raizada
11-Oct-2018
Learn How to Build a Bot
Amazon Lex and Amazon Polly

3. Intelligent Multimodal Interfaces

4. Learning outcomes
• Amazon Lex and Amazon Polly concepts,
controls and features
• Creating and testing in the AWS console
• Using Lambda functions to control conversation flow
• Managing the conversation context using
session-based attributes
• How we can interact with our bot using text from
our website or Facebook Messenger,
or voice from our kiosk

5. Speech
Recognition
Natural Language
Understanding
Powered by the same deep learning technology as Alexa
Amazon Lex

6. Voice and text
“chatbots”
Powers
Alexa
Voice interactions on
mobile, web, and devices
Text interaction
with Slack, Twilio SMS,
& Facebook Messenger
Amazon Lex

7. Utterances
Spoken or typed phrases that invoke
your intent
BookHotel
Intents
An intent performs an action in response
to natural language user input. Custom
and built-in intents are supported
Slots
Slots are input data required to fulfill
the intent
Fulfillment
Fulfillment mechanism for your intent
Amazon Lex - concepts

8. AMAZON.HelpIntent
Help me Help!
Cancel Never mind Forget it
Built-in intents
AMAZON.CancelIntent

9. AMAZON.Date
February
first
Next
Tuesday
This
weekend
2018-02-01 2017-09-12 2017-W36-WE
Built-in slot types

10. Voice quality and pronunciation
1. Automatic, accurate text processing
2. Intelligible and easy to understand
3. Add semantic meaning to text
4. Customized pronunciation
Character voices
Articles and blogs
Training material
Chatbots (Amazon Lex)
Public announcements
Converts text
to life-like speech
52 voices 25 languages Low latency,
real time
Fully managed
Amazon Polly

11. “Coffee Bot”
Order Small
Mocha
“I’d like to order a small
Mocha”
Automatic Speech
Recognition
CafeOrderBeverage
Small Mocha
Natural Language
Understanding
Intent/Slot
Model
UtterancesCoffee Bot
Type Mocha
Size Small
Temperature Hot
“Your mocha will be
available soon!”
Polly
Confirmation: “Your mocha
will be available soon!”
a
“You’d like a small
mocha, is that right?

12. Time to code: Build CoffeeBot
https://s3.us-east-2.amazonaws.com/mast-mast/public/labs/lex-pressobot/readme.html
http://bit.ly/2nG8oIG
• Intents, Slot Types, Utterances
• Lambda
• CloudWatch metrics

13. Start with a Bot

22. Add Lambda Function

23. • Customise user interaction
• Validate user input
• Fulfill user intent
Code hooks – trigger Lambda functions

24. • sessionAttributes
• dialogAction
• type
• Close No further response
• ConfirmIntent Yes or no to confirm
• Delegate Let Amazon Lex decide
• ElicitIntent “Go to” an intent
• ElicitSlot “Go to” a slot
• slots
Dialog code hook response

25. Managing conversation context
• You can transfer slot values between Intents
using sessionAttributes

35. Voice and text
“chatbots”
Powers
Alexa
Voice interactions on
mobile, web, and devices
Text interaction
with Slack, Twilio SMS,
& Facebook Messenger
Building a kiosk – integrating voice

36. • Simple configuration for social
platform integration
• Facebook Messenger, Slack, Kik
and Twilio SMS native support
• Response cards allow user to
select from a set of responses
• Easily return response cards using
the helper functions in the Lambda
Blueprints
Integration with social platforms

38. Amazon API
Gateway
Lambda
functions
TravelBuddy – website architecture
Amazon
DynamoDB
Amazon
ElasticSearch
Amazon
S3
Amazon
CloudFront
Externaldatasources
Amazon
Cognito

39. Amazon
Cognito
Amazon API
Gateway
TravelBuddy – website with text chatbot
Amazon
ElasticSearch
Amazon
S3
Amazon
CloudFront
Externaldatasources
Amazon
Lex
Lambda
functions
Amazon
DynamoDB

41. DEMO

42. DEMO

43. Thank You!

44. Don’t Forget Evaluations!

45. New to AWS
Introductory labs and
videos can help you
ramp up
Online Labs
Take an online Self-
Paced Lab to get hands-
on-practice with AWS
services
Take a Class
Build technical skills and
learn best practices
from an accredited
instructor
AWS Certification
Validate knowledge and
show expertise with
industry recognized
certifications
Learn more: aws.amazon.com/training
Start Learning Start Practicing Find a Class Get Certified