SlideShare a Scribd company logo
AMAZON ALEXA
our successes and fails
15 Sep 2017
DevBDay
Viachaslau Lialkin
EPAM Systems
vlialkin
2
3
Introduction to
Amazon Alexa
4
Amazon Alexa is the cloud-based "brain" behind
Amazon voice assistant devices.
5
Music & Entertainment
News & Information
Calling & Messaging
Help Around the House
Shopping experience
Custom Skills
Assists with
6
// Information & Help
7
// Music
8
// Smart home
9
There is also store for Alexa Skills …
11
Echo Dot
$49.99
Amazon Echo
$179.99
Echo Show
$229.99
// Devices
12
Amazon Alexa engine
Amazon Echo
Amazon Echo Dot devices
Amazon Echo Show
13
How phrases
are built?
14
Alexa, ask Uber to request a ride
15
Keyword
First word in every request
Required to wake up the device
Alexa, ask Uber to request a ride
16
Skill invocation name
Defined by Skill developer
Phrase is sent to the concrete Skill
Alexa, ask Uber to request a ride
17
Intent from the Uber Skill
Should be defined by Skill developer
Multiple utterances of single action are possible
Alexa, ask Uber to request a ride
18
Alexa, set timer for 20 minutes
No skill invocation name, because
it is built-it Alexa functionality
19
20
// How to create Skill
- Set Invocation Name (string)
- Build Interaction Model (json)
- Implement Speechlet interface
void onSessionStarted(SessionStartedRequest, Session)
void onSessionEnded(SessionEndedRequest, Session)
SpeechletResponse onLaunch(LaunchRequest, Session)
SpeechletResponse onIntent(IntentRequest, Session)
21
// How to test
- Use devices (thanks, Captain!)
- Use text emulator
- Use voice emulator
Story #1: Alexa Office 
23
Alexa, ask Office where is Viachaslau Lialkin
24
Alexa, ask Office where is Viachaslau Lialkin
Viachaslau Lialkin is on the meeting till 17:00
Viachaslau Lialkin is on vacation till September 22
Unfortunately Viachaslau Lialkin is on sick leave today
25
// How does it work
HTTPS
Web-app
(Java)
Telescope API
MS Exchange API
Amazon Developer web-interface
"office" EmployeeAvailabilityIntent
- "where is {EmployeeName} now",
- "is {EmployeeName} free now",
- "is {EmployeeName} available now",
- "is {EmployeeName} busy now",
- "to find {EmployeeName}"
Heroku
Endpoint
Type
(our URL)
Skill
Name
External APIs
Invocation
Name
("office")
26
// What did we do well
- Integration w/ external systems
- Synonyms in Interaction Model (voice-to-text)
- Synonyms in web-app (text-to-identifier)
- Transcription of names in web-app (text-to-voice)
OK
OK
OK
OK
27
- Bad recognition and pronunciation of
names (voice-to-text and text-to-voice)
- Not convenient to ask Alexa and better to
check manually
ERR
ERR
// Known problems
Story #2: Alexa Question 
29
Alexa, ask Question
30
Java Core - Could you please describe, what is
happening during adding element into LinkedList?
Spring - What is DispatcherServlet?
Alexa, ask Question
Design Patterns - Could you please compare
patterns Facade and Adapter?
31
// How does it work
%
Amazon Developer web-interface
"question" QuestionIntent
- "question",
- "please",
- "next",
- "repeat",
- "from {tag}",
- "about {tag}"
TXT-file
with 60+
questions
Skill
Name
Invocation
Name
("question")
33
34

More Related Content

What's hot

How to create a Voice – Enabled IoT solution for Alexa
How to create a Voice – Enabled IoT solution for AlexaHow to create a Voice – Enabled IoT solution for Alexa
How to create a Voice – Enabled IoT solution for Alexa
Amazon Web Services
 
Voice enable all the things with Alexa
Voice enable all the things with AlexaVoice enable all the things with Alexa
Voice enable all the things with Alexa
Mark Bate
 
An Introduction to Using AWS and ASK to Build Voice Driven Experiences
An Introduction to Using AWS and ASK to Build Voice Driven ExperiencesAn Introduction to Using AWS and ASK to Build Voice Driven Experiences
An Introduction to Using AWS and ASK to Build Voice Driven Experiences
Amazon Web Services
 
Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101
Amazon Web Services
 
Amazon Alexa and AWS Lambda
Amazon Alexa and AWS LambdaAmazon Alexa and AWS Lambda
Amazon Alexa and AWS Lambda
Amazon Web Services
 
Your First Amazon Alexa Skill
Your First Amazon Alexa SkillYour First Amazon Alexa Skill
Your First Amazon Alexa Skill
Mike Christianson
 
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
Amazon Web Services
 
Speak Up! Build an Alexa Skill for a Cause
 Speak Up! Build an Alexa Skill for a Cause Speak Up! Build an Alexa Skill for a Cause
Speak Up! Build an Alexa Skill for a Cause
Nikki Clark
 
Amazon Alexa and Echo
Amazon Alexa  and EchoAmazon Alexa  and Echo
Amazon Alexa and Echo
Mahesh Mahajan
 
WKS403 Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda WKS403 Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda
Amazon Web Services
 
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
Amazon Web Services
 
Having fun with alexa
Having fun with alexaHaving fun with alexa
Having fun with alexa
Jeroen Resoort
 
Introduction to building alexa skills and putting your amazon echo to work
Introduction to building alexa skills and putting your amazon echo to workIntroduction to building alexa skills and putting your amazon echo to work
Introduction to building alexa skills and putting your amazon echo to work
Abe Diaz
 
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS LambdaDavid Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
WithTheBest
 
Amazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom SkillsAmazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom Skills
André Maré
 
Develop Alexa Skills for Amazon Echo with PHP
Develop Alexa Skills for Amazon Echo with PHPDevelop Alexa Skills for Amazon Echo with PHP
Develop Alexa Skills for Amazon Echo with PHP
Ralf Eggert
 
Enabling New Voice Experiences with Amazon Alexa and AWS Lambda
Enabling New Voice Experiences with Amazon Alexa and AWS LambdaEnabling New Voice Experiences with Amazon Alexa and AWS Lambda
Enabling New Voice Experiences with Amazon Alexa and AWS Lambda
Amazon Web Services
 
Alexa Skills Kit with Web API on Azure
Alexa Skills Kit with Web API on AzureAlexa Skills Kit with Web API on Azure
Alexa Skills Kit with Web API on Azure
Heather Downing
 
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
Amazon Web Services
 
Alexa Skills Kit
Alexa Skills KitAlexa Skills Kit
Alexa Skills Kit
Jun Ichikawa
 

What's hot (20)

How to create a Voice – Enabled IoT solution for Alexa
How to create a Voice – Enabled IoT solution for AlexaHow to create a Voice – Enabled IoT solution for Alexa
How to create a Voice – Enabled IoT solution for Alexa
 
Voice enable all the things with Alexa
Voice enable all the things with AlexaVoice enable all the things with Alexa
Voice enable all the things with Alexa
 
An Introduction to Using AWS and ASK to Build Voice Driven Experiences
An Introduction to Using AWS and ASK to Build Voice Driven ExperiencesAn Introduction to Using AWS and ASK to Build Voice Driven Experiences
An Introduction to Using AWS and ASK to Build Voice Driven Experiences
 
Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101
 
Amazon Alexa and AWS Lambda
Amazon Alexa and AWS LambdaAmazon Alexa and AWS Lambda
Amazon Alexa and AWS Lambda
 
Your First Amazon Alexa Skill
Your First Amazon Alexa SkillYour First Amazon Alexa Skill
Your First Amazon Alexa Skill
 
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
 
Speak Up! Build an Alexa Skill for a Cause
 Speak Up! Build an Alexa Skill for a Cause Speak Up! Build an Alexa Skill for a Cause
Speak Up! Build an Alexa Skill for a Cause
 
Amazon Alexa and Echo
Amazon Alexa  and EchoAmazon Alexa  and Echo
Amazon Alexa and Echo
 
WKS403 Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda WKS403 Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda
 
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
 
Having fun with alexa
Having fun with alexaHaving fun with alexa
Having fun with alexa
 
Introduction to building alexa skills and putting your amazon echo to work
Introduction to building alexa skills and putting your amazon echo to workIntroduction to building alexa skills and putting your amazon echo to work
Introduction to building alexa skills and putting your amazon echo to work
 
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS LambdaDavid Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
David Isbitski - Enabling new voice experiences with Amazon Alexa and AWS Lambda
 
Amazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom SkillsAmazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom Skills
 
Develop Alexa Skills for Amazon Echo with PHP
Develop Alexa Skills for Amazon Echo with PHPDevelop Alexa Skills for Amazon Echo with PHP
Develop Alexa Skills for Amazon Echo with PHP
 
Enabling New Voice Experiences with Amazon Alexa and AWS Lambda
Enabling New Voice Experiences with Amazon Alexa and AWS LambdaEnabling New Voice Experiences with Amazon Alexa and AWS Lambda
Enabling New Voice Experiences with Amazon Alexa and AWS Lambda
 
Alexa Skills Kit with Web API on Azure
Alexa Skills Kit with Web API on AzureAlexa Skills Kit with Web API on Azure
Alexa Skills Kit with Web API on Azure
 
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
AWS re:Invent 2016: From VUI to QA: Building a Voice-Based Adventure Game for...
 
Alexa Skills Kit
Alexa Skills KitAlexa Skills Kit
Alexa Skills Kit
 

Viewers also liked

Build an Alexa Skill Step-by-Step
Build an Alexa Skill Step-by-StepBuild an Alexa Skill Step-by-Step
Build an Alexa Skill Step-by-Step
Rick Wargo
 
(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood
Amazon Web Services
 
Alexa Hackathon - The 5 Love Languages
Alexa Hackathon - The 5 Love LanguagesAlexa Hackathon - The 5 Love Languages
Alexa Hackathon - The 5 Love Languages
Frances Coronel
 
Google Home
Google HomeGoogle Home
Google Home
Sharon Flaherty
 
IoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google HomeIoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google Home
Comrade
 
Voice Assistants: Neuigkeiten von Alexa und Google Home
Voice Assistants: Neuigkeiten von Alexa und Google HomeVoice Assistants: Neuigkeiten von Alexa und Google Home
Voice Assistants: Neuigkeiten von Alexa und Google Home
inovex GmbH
 
Siri Vs Google Now
Siri Vs Google NowSiri Vs Google Now
Siri Vs Google Now
MeasurementMarketing.io
 
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
Edureka!
 
Virtual personal assistant
Virtual personal assistantVirtual personal assistant
Virtual personal assistant
Shubham Bhalekar
 
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
Edureka!
 
Use voice recognition with Alexa to control your home [JavaOne]
Use voice recognition with Alexa to control your home [JavaOne]Use voice recognition with Alexa to control your home [JavaOne]
Use voice recognition with Alexa to control your home [JavaOne]
Johan Janssen
 
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
Edureka!
 
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Edureka!
 
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
Edureka!
 
The AI Rush
The AI RushThe AI Rush

Viewers also liked (15)

Build an Alexa Skill Step-by-Step
Build an Alexa Skill Step-by-StepBuild an Alexa Skill Step-by-Step
Build an Alexa Skill Step-by-Step
 
(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood(MBL310) Alexa Voice Service Under the Hood
(MBL310) Alexa Voice Service Under the Hood
 
Alexa Hackathon - The 5 Love Languages
Alexa Hackathon - The 5 Love LanguagesAlexa Hackathon - The 5 Love Languages
Alexa Hackathon - The 5 Love Languages
 
Google Home
Google HomeGoogle Home
Google Home
 
IoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google HomeIoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google Home
 
Voice Assistants: Neuigkeiten von Alexa und Google Home
Voice Assistants: Neuigkeiten von Alexa und Google HomeVoice Assistants: Neuigkeiten von Alexa und Google Home
Voice Assistants: Neuigkeiten von Alexa und Google Home
 
Siri Vs Google Now
Siri Vs Google NowSiri Vs Google Now
Siri Vs Google Now
 
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
React Components Lifecycle | React Tutorial for Beginners | ReactJS Training ...
 
Virtual personal assistant
Virtual personal assistantVirtual personal assistant
Virtual personal assistant
 
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
ReactJS Tutorial For Beginners | ReactJS Redux Training For Beginners | React...
 
Use voice recognition with Alexa to control your home [JavaOne]
Use voice recognition with Alexa to control your home [JavaOne]Use voice recognition with Alexa to control your home [JavaOne]
Use voice recognition with Alexa to control your home [JavaOne]
 
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
Angular 4 Data Binding | Two Way Data Binding in Angular 4 | Angular 4 Tutori...
 
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
Big Data Tutorial For Beginners | What Is Big Data | Big Data Tutorial | Hado...
 
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
What is Artificial Intelligence | Artificial Intelligence Tutorial For Beginn...
 
The AI Rush
The AI RushThe AI Rush
The AI Rush
 

Similar to Amazon Alexa: our successes and fails

ALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa SkillsALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa Skills
Amazon Web Services
 
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike CallahanITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
Ortus Solutions, Corp
 
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding WorkshopDigital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Dinah Barrett
 
Virtual assistant with amazon alexa
Virtual assistant with amazon alexaVirtual assistant with amazon alexa
Virtual assistant with amazon alexa
Nguyen Giang
 
Bring Alexa to Work - ENT306 - Chicago AWS Summit
Bring Alexa to Work - ENT306 - Chicago AWS SummitBring Alexa to Work - ENT306 - Chicago AWS Summit
Bring Alexa to Work - ENT306 - Chicago AWS Summit
Amazon Web Services
 
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
Lviv Startup Club
 
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
Amazon Web Services
 
WKS403 Build an Alexa Skill using AWS Lambda
WKS403   Build an Alexa Skill using AWS LambdaWKS403   Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda
Amazon Web Services
 
Integrate drupal 8 with alexa - Rakshith
Integrate drupal 8 with alexa - RakshithIntegrate drupal 8 with alexa - Rakshith
Integrate drupal 8 with alexa - Rakshith
Rakshith Tb
 
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
Amazon Web Services
 
Alexa for Developers
Alexa for DevelopersAlexa for Developers
Alexa for Developers
Sébastien ☁ Stormacq
 
ALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your ProductALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your Product
Amazon Web Services
 
使用 Serverless 技術打造支援 Alexa 的物聯網服務
使用 Serverless 技術打造支援 Alexa 的物聯網服務使用 Serverless 技術打造支援 Alexa 的物聯網服務
使用 Serverless 技術打造支援 Alexa 的物聯網服務
Amazon Web Services
 
AI on a PI
AI on a PIAI on a PI
AI on a PI
Julien SIMON
 
VoxxedDays Bucharest 2019 - Alexa, nice to meet you
VoxxedDays Bucharest 2019 - Alexa, nice to meet youVoxxedDays Bucharest 2019 - Alexa, nice to meet you
VoxxedDays Bucharest 2019 - Alexa, nice to meet you
Iván López Martín
 
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
Amazon Web Services
 
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
Amazon Web Services
 
AI Overview
AI OverviewAI Overview
AI Overview
Amazon Web Services
 
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
Amazon Web Services
 
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNetRaleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
Amazon Web Services
 

Similar to Amazon Alexa: our successes and fails (20)

ALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa SkillsALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa Skills
 
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike CallahanITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
ITB2019 Easily Build Amazon Alexa skills with ColdFusion - Mike Callahan
 
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding WorkshopDigital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
 
Virtual assistant with amazon alexa
Virtual assistant with amazon alexaVirtual assistant with amazon alexa
Virtual assistant with amazon alexa
 
Bring Alexa to Work - ENT306 - Chicago AWS Summit
Bring Alexa to Work - ENT306 - Chicago AWS SummitBring Alexa to Work - ENT306 - Chicago AWS Summit
Bring Alexa to Work - ENT306 - Chicago AWS Summit
 
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
Valentyn Buleiko “Shedding light on the possibilities of voice assistants by ...
 
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
 
WKS403 Build an Alexa Skill using AWS Lambda
WKS403   Build an Alexa Skill using AWS LambdaWKS403   Build an Alexa Skill using AWS Lambda
WKS403 Build an Alexa Skill using AWS Lambda
 
Integrate drupal 8 with alexa - Rakshith
Integrate drupal 8 with alexa - RakshithIntegrate drupal 8 with alexa - Rakshith
Integrate drupal 8 with alexa - Rakshith
 
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
How to Build a Backend for an Alexa Smart Home Skill - ALX316 - re:Invent 2017
 
Alexa for Developers
Alexa for DevelopersAlexa for Developers
Alexa for Developers
 
ALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your ProductALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your Product
 
使用 Serverless 技術打造支援 Alexa 的物聯網服務
使用 Serverless 技術打造支援 Alexa 的物聯網服務使用 Serverless 技術打造支援 Alexa 的物聯網服務
使用 Serverless 技術打造支援 Alexa 的物聯網服務
 
AI on a PI
AI on a PIAI on a PI
AI on a PI
 
VoxxedDays Bucharest 2019 - Alexa, nice to meet you
VoxxedDays Bucharest 2019 - Alexa, nice to meet youVoxxedDays Bucharest 2019 - Alexa, nice to meet you
VoxxedDays Bucharest 2019 - Alexa, nice to meet you
 
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
An Overview of AI at AWS: Amazon Lex, Amazon Polly, Amazon Rekognition, Apach...
 
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
 
AI Overview
AI OverviewAI Overview
AI Overview
 
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
NEW LAUNCH! Deploying and Managing Voice Skills in your Organization with Ale...
 
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNetRaleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
Raleigh DevDay 2017: Distributed Deep Learning on AWS with Apache MXNet
 

Recently uploaded

Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
ThomasParaiso2
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 

Recently uploaded (20)

Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 

Amazon Alexa: our successes and fails

  • 1. AMAZON ALEXA our successes and fails 15 Sep 2017 DevBDay
  • 4. 4 Amazon Alexa is the cloud-based "brain" behind Amazon voice assistant devices.
  • 5. 5 Music & Entertainment News & Information Calling & Messaging Help Around the House Shopping experience Custom Skills Assists with
  • 9. 9 There is also store for Alexa Skills …
  • 10.
  • 12. 12 Amazon Alexa engine Amazon Echo Amazon Echo Dot devices Amazon Echo Show
  • 14. 14 Alexa, ask Uber to request a ride
  • 15. 15 Keyword First word in every request Required to wake up the device Alexa, ask Uber to request a ride
  • 16. 16 Skill invocation name Defined by Skill developer Phrase is sent to the concrete Skill Alexa, ask Uber to request a ride
  • 17. 17 Intent from the Uber Skill Should be defined by Skill developer Multiple utterances of single action are possible Alexa, ask Uber to request a ride
  • 18. 18 Alexa, set timer for 20 minutes No skill invocation name, because it is built-it Alexa functionality
  • 19. 19
  • 20. 20 // How to create Skill - Set Invocation Name (string) - Build Interaction Model (json) - Implement Speechlet interface void onSessionStarted(SessionStartedRequest, Session) void onSessionEnded(SessionEndedRequest, Session) SpeechletResponse onLaunch(LaunchRequest, Session) SpeechletResponse onIntent(IntentRequest, Session)
  • 21. 21 // How to test - Use devices (thanks, Captain!) - Use text emulator - Use voice emulator
  • 22. Story #1: Alexa Office 
  • 23. 23 Alexa, ask Office where is Viachaslau Lialkin
  • 24. 24 Alexa, ask Office where is Viachaslau Lialkin Viachaslau Lialkin is on the meeting till 17:00 Viachaslau Lialkin is on vacation till September 22 Unfortunately Viachaslau Lialkin is on sick leave today
  • 25. 25 // How does it work HTTPS Web-app (Java) Telescope API MS Exchange API Amazon Developer web-interface "office" EmployeeAvailabilityIntent - "where is {EmployeeName} now", - "is {EmployeeName} free now", - "is {EmployeeName} available now", - "is {EmployeeName} busy now", - "to find {EmployeeName}" Heroku Endpoint Type (our URL) Skill Name External APIs Invocation Name ("office")
  • 26. 26 // What did we do well - Integration w/ external systems - Synonyms in Interaction Model (voice-to-text) - Synonyms in web-app (text-to-identifier) - Transcription of names in web-app (text-to-voice) OK OK OK OK
  • 27. 27 - Bad recognition and pronunciation of names (voice-to-text and text-to-voice) - Not convenient to ask Alexa and better to check manually ERR ERR // Known problems
  • 28. Story #2: Alexa Question 
  • 30. 30 Java Core - Could you please describe, what is happening during adding element into LinkedList? Spring - What is DispatcherServlet? Alexa, ask Question Design Patterns - Could you please compare patterns Facade and Adapter?
  • 31. 31 // How does it work % Amazon Developer web-interface "question" QuestionIntent - "question", - "please", - "next", - "repeat", - "from {tag}", - "about {tag}" TXT-file with 60+ questions Skill Name Invocation Name ("question")
  • 32.
  • 33. 33
  • 34. 34