SlideShare a Scribd company logo
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VOICE PLUS SCREEN:
Designing Multi-modal Devices with
Alexa Voice Services
AWS re:INVENT
O r i N e i d i c h
A L X 3 1 8
N o v e m b e r 2 7 , 2 0 1 7
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Voice chrome & interactions on tablet
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Vision: Alexa anywhere
Home audio
Thermostats
Automobiles
Maker boards
Wearables
Small appliances
Smartphones
Large appliancesHome security
TV/Video
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Simplifying voice design
Directives
Instructions sent from AVS to client
Events
Information sent from client to AVS
Voice hardware
Audio front end
Device software
AVS Device SDK
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Display Cards for Alexa
A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Display Cards for Alexa
Weather, to-do and lists, calendars, and other Alexa skills Now Playing for media
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Display Cards: Flow & delivery
“Alexa, who is
Usain Bolt?”
SpeechRecognizer.Recognize
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Display Cards: Flow & delivery
Alexa TTS: “Usain
St Leo Bolt…”
SpeechSynthesizer.Speak
Alexa sends a
RenderTemplate
directive with the
JSON for your
request.
TemplateRuntime.RenderTemplate
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RenderTemplate directive
• BodyTemplate1: text-only visual metadata
• BodyTemplate2: text and a single image
• ListTemplate1: to-do, shopping, and calendar lists
• WeatherTemplate: weather forecast
RenderPlayerInfo directive
• Now Playing info
TemplateRuntime interface
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
BodyTemplate2 Example
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Voice chrome & interactions on TV
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Live demo
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Code-based linking
A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Problem
Onscreen keyboards are bad news. Very bad news if people are trying to type in credentials.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Solution: CBL
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CBL flow
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Alexa smart home & video skills
A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ACTIONS
SH AV
Smart home skills for entertainment devices
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smart Home for AV interfaces
Operation Capability interface
Turn things on and off Alexa.PowerController
Change the channel on a device Alexa.ChannelController
Change the input of a playback device Alexa.InputController
Control the playback of device; fast forward,
rewind, and pause
Alexa.PlaybackController
Change the volume in incremental steps Alexa.StepSpeaker
Change the volume to anywhere on a continuous
range
Alexa.Speaker
Indicate an error has occurred Alexa.ErrorResponse
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VIDEOSH AV
APIs
Video Skill API
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hisense TV demonstration
A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hisense demo
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
A L X 3 1 8 : D e s i g n i n g m u l t i -
m o d a l d e v i c e s w i t h A V S
Visit the Alexa developer portal for more:
AVS: Alexa Voice Services
developer.amazon.com/avs
AVS: Display Cards
developer.amazon.com/alexa-voice-service/gui
AVS: Code-based linking
developer.amazon.com/docs/alexa-voice-service/code-based-
linking-other-platforms.html
AVS: Design Guide
developer.amazon.com/docs/alexa-voice-service/ux-design-
overview.html#displaycards
ASK: Smart home for entertainment
developer.amazon.com/docs/smarthome/build-smart-home-skills-
for-entertainment-devices.html
ASK: Video Skills
developer.amazon.com/alexa-skills-kit/video-content
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!

More Related Content

What's hot

LFS309-High-Throughput Genomics on AWS.pdf
LFS309-High-Throughput Genomics on AWS.pdfLFS309-High-Throughput Genomics on AWS.pdf
LFS309-High-Throughput Genomics on AWS.pdf
Amazon Web Services
 
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
Amazon Web Services
 
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex PollexyMCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
Amazon Web Services
 
Driving effective Digital User Engagement using Analytics, Push Notifications...
Driving effective Digital User Engagement using Analytics, Push Notifications...Driving effective Digital User Engagement using Analytics, Push Notifications...
Driving effective Digital User Engagement using Analytics, Push Notifications...
Amazon Web Services
 
CON203_Driving Innovation with Containers
CON203_Driving Innovation with ContainersCON203_Driving Innovation with Containers
CON203_Driving Innovation with Containers
Amazon Web Services
 
ALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your ProductALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your Product
Amazon Web Services
 
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
Amazon Web Services
 
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
Amazon Web Services
 
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
Amazon Web Services
 
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
Amazon Web Services
 
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
Amazon Web Services
 
CTD403_Supercharge Your Websites with the Power of Lambda@Edge
CTD403_Supercharge Your Websites with the Power of Lambda@EdgeCTD403_Supercharge Your Websites with the Power of Lambda@Edge
CTD403_Supercharge Your Websites with the Power of Lambda@Edge
Amazon Web Services
 
MAE301_Boom for your Buck
MAE301_Boom for your BuckMAE301_Boom for your Buck
MAE301_Boom for your Buck
Amazon Web Services
 
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
Amazon Web Services
 
MCL306_Making IoT Smarter with AWS Rekognition.pdf
MCL306_Making IoT Smarter with AWS Rekognition.pdfMCL306_Making IoT Smarter with AWS Rekognition.pdf
MCL306_Making IoT Smarter with AWS Rekognition.pdf
Amazon Web Services
 
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
Amazon Web Services
 
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
Amazon Web Services
 
MCL205_Introduction to Deep Learning
MCL205_Introduction to Deep LearningMCL205_Introduction to Deep Learning
MCL205_Introduction to Deep Learning
Amazon Web Services
 
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
Amazon Web Services
 
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Amazon Web Services
 

What's hot (20)

LFS309-High-Throughput Genomics on AWS.pdf
LFS309-High-Throughput Genomics on AWS.pdfLFS309-High-Throughput Genomics on AWS.pdf
LFS309-High-Throughput Genomics on AWS.pdf
 
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
Alexa State of the Science - ALX321 - 2h amazonwebservices Deep Dive into Ama...
 
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex PollexyMCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
 
Driving effective Digital User Engagement using Analytics, Push Notifications...
Driving effective Digital User Engagement using Analytics, Push Notifications...Driving effective Digital User Engagement using Analytics, Push Notifications...
Driving effective Digital User Engagement using Analytics, Push Notifications...
 
CON203_Driving Innovation with Containers
CON203_Driving Innovation with ContainersCON203_Driving Innovation with Containers
CON203_Driving Innovation with Containers
 
ALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your ProductALX307_Integrate Alexa into Your Product
ALX307_Integrate Alexa into Your Product
 
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
MAE303-OTT State of Play Innovation at Netflix, Hulu, Amazon Video, and AWS E...
 
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
CMP314_Bringing Deep Learning to the Cloud with Amazon EC2
 
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
Testing and Troubleshooting with AWS Device Farm - MBL301 - re:Invent 2017
 
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
ALX202_Integrate Alexa voice technology into your product with the Alexa Voic...
 
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
NEW LAUNCH! Deep dive on Amazon Neptune - DAT318 - re:Invent 2017
 
CTD403_Supercharge Your Websites with the Power of Lambda@Edge
CTD403_Supercharge Your Websites with the Power of Lambda@EdgeCTD403_Supercharge Your Websites with the Power of Lambda@Edge
CTD403_Supercharge Your Websites with the Power of Lambda@Edge
 
MAE301_Boom for your Buck
MAE301_Boom for your BuckMAE301_Boom for your Buck
MAE301_Boom for your Buck
 
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
NEW LAUNCH! Building Smart Conference Rooms with Alexa for Business - BAP309 ...
 
MCL306_Making IoT Smarter with AWS Rekognition.pdf
MCL306_Making IoT Smarter with AWS Rekognition.pdfMCL306_Making IoT Smarter with AWS Rekognition.pdf
MCL306_Making IoT Smarter with AWS Rekognition.pdf
 
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
 
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
 
MCL205_Introduction to Deep Learning
MCL205_Introduction to Deep LearningMCL205_Introduction to Deep Learning
MCL205_Introduction to Deep Learning
 
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017
 
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
 

Similar to ALX318-Voice Plus Screen How to Design Multi-Modal Devices with the Alexa Voice Service

Smart Devices Everywhere - ALX328 - re:Invent 2017
Smart Devices Everywhere - ALX328 - re:Invent 2017Smart Devices Everywhere - ALX328 - re:Invent 2017
Smart Devices Everywhere - ALX328 - re:Invent 2017
Amazon Web Services
 
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
Amazon Web Services
 
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
Amazon Web Services
 
MBL306_Mobile State of the Union
MBL306_Mobile State of the UnionMBL306_Mobile State of the Union
MBL306_Mobile State of the Union
Amazon Web Services
 
Conversation and Memory - ALX401-R - re:Invent 2017
Conversation and Memory - ALX401-R - re:Invent 2017Conversation and Memory - ALX401-R - re:Invent 2017
Conversation and Memory - ALX401-R - re:Invent 2017
Amazon Web Services
 
Podcasting on AWS – A Discussion on Everything from Production to Distributio...
Podcasting on AWS – A Discussion on Everything from Production to Distributio...Podcasting on AWS – A Discussion on Everything from Production to Distributio...
Podcasting on AWS – A Discussion on Everything from Production to Distributio...
Amazon Web Services
 
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
Amazon Web Services
 
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoTIOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
Amazon Web Services
 
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
Amazon Web Services
 
AI: State of the Union
AI: State of the UnionAI: State of the Union
AI: State of the Union
Amazon Web Services
 
CTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video WorkflowsCTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video Workflows
Amazon Web Services
 
Intro to Amazon AI Services
Intro to Amazon AI ServicesIntro to Amazon AI Services
Intro to Amazon AI Services
Amazon Web Services
 
An Introduction to AI Services on AWS - Web Summit Lisbon
An Introduction to AI Services on AWS -  Web Summit LisbonAn Introduction to AI Services on AWS -  Web Summit Lisbon
An Introduction to AI Services on AWS - Web Summit Lisbon
Boaz Ziniman
 
MCL207_Amazon Lex Integration with IVR
MCL207_Amazon Lex Integration with IVRMCL207_Amazon Lex Integration with IVR
MCL207_Amazon Lex Integration with IVR
Amazon Web Services
 
Launch Applications the Amazon Way - AWS Online Tech Talks
Launch Applications the Amazon Way - AWS Online Tech TalksLaunch Applications the Amazon Way - AWS Online Tech Talks
Launch Applications the Amazon Way - AWS Online Tech Talks
Amazon Web Services
 
AWSome Day - Opening Keynote
AWSome Day - Opening KeynoteAWSome Day - Opening Keynote
AWSome Day - Opening Keynote
Adrian Hornsby
 
Keynote - AWSome Day Copenhagen
Keynote - AWSome Day Copenhagen Keynote - AWSome Day Copenhagen
Keynote - AWSome Day Copenhagen
Amazon Web Services
 
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging CodeAWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
Amazon Web Services
 
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
New Relic
 
Alexa連携デバイスクラウドを構成するAWS ソリューション
Alexa連携デバイスクラウドを構成するAWS ソリューションAlexa連携デバイスクラウドを構成するAWS ソリューション
Alexa連携デバイスクラウドを構成するAWS ソリューション
Toshiaki Enami
 

Similar to ALX318-Voice Plus Screen How to Design Multi-Modal Devices with the Alexa Voice Service (20)

Smart Devices Everywhere - ALX328 - re:Invent 2017
Smart Devices Everywhere - ALX328 - re:Invent 2017Smart Devices Everywhere - ALX328 - re:Invent 2017
Smart Devices Everywhere - ALX328 - re:Invent 2017
 
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voi...
 
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
Bringing the Superpower of Bots to Your Company with a Serverless Bot Solutio...
 
MBL306_Mobile State of the Union
MBL306_Mobile State of the UnionMBL306_Mobile State of the Union
MBL306_Mobile State of the Union
 
Conversation and Memory - ALX401-R - re:Invent 2017
Conversation and Memory - ALX401-R - re:Invent 2017Conversation and Memory - ALX401-R - re:Invent 2017
Conversation and Memory - ALX401-R - re:Invent 2017
 
Podcasting on AWS – A Discussion on Everything from Production to Distributio...
Podcasting on AWS – A Discussion on Everything from Production to Distributio...Podcasting on AWS – A Discussion on Everything from Production to Distributio...
Podcasting on AWS – A Discussion on Everything from Production to Distributio...
 
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
Learn How AWS is Enabling the World's Most Advanced Media Workflows - CTD202 ...
 
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoTIOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
IOT308-One Message to a Million Things Done in 60 seconds with AWS IoT
 
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
NEW LAUNCH! Bring Alexa to Work! Voice-enable Your Organization with Alexa fo...
 
AI: State of the Union
AI: State of the UnionAI: State of the Union
AI: State of the Union
 
CTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video WorkflowsCTD405_Building Serverless Video Workflows
CTD405_Building Serverless Video Workflows
 
Intro to Amazon AI Services
Intro to Amazon AI ServicesIntro to Amazon AI Services
Intro to Amazon AI Services
 
An Introduction to AI Services on AWS - Web Summit Lisbon
An Introduction to AI Services on AWS -  Web Summit LisbonAn Introduction to AI Services on AWS -  Web Summit Lisbon
An Introduction to AI Services on AWS - Web Summit Lisbon
 
MCL207_Amazon Lex Integration with IVR
MCL207_Amazon Lex Integration with IVRMCL207_Amazon Lex Integration with IVR
MCL207_Amazon Lex Integration with IVR
 
Launch Applications the Amazon Way - AWS Online Tech Talks
Launch Applications the Amazon Way - AWS Online Tech TalksLaunch Applications the Amazon Way - AWS Online Tech Talks
Launch Applications the Amazon Way - AWS Online Tech Talks
 
AWSome Day - Opening Keynote
AWSome Day - Opening KeynoteAWSome Day - Opening Keynote
AWSome Day - Opening Keynote
 
Keynote - AWSome Day Copenhagen
Keynote - AWSome Day Copenhagen Keynote - AWSome Day Copenhagen
Keynote - AWSome Day Copenhagen
 
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging CodeAWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
 
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...
 
Alexa連携デバイスクラウドを構成するAWS ソリューション
Alexa連携デバイスクラウドを構成するAWS ソリューションAlexa連携デバイスクラウドを構成するAWS ソリューション
Alexa連携デバイスクラウドを構成するAWS ソリューション
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
Amazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
Amazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
Amazon Web Services
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Amazon Web Services
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
Amazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
Amazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Amazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
Amazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Amazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

ALX318-Voice Plus Screen How to Design Multi-Modal Devices with the Alexa Voice Service

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VOICE PLUS SCREEN: Designing Multi-modal Devices with Alexa Voice Services AWS re:INVENT O r i N e i d i c h A L X 3 1 8 N o v e m b e r 2 7 , 2 0 1 7
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Voice chrome & interactions on tablet
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Vision: Alexa anywhere Home audio Thermostats Automobiles Maker boards Wearables Small appliances Smartphones Large appliancesHome security TV/Video
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Simplifying voice design Directives Instructions sent from AVS to client Events Information sent from client to AVS Voice hardware Audio front end Device software AVS Device SDK
  • 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Display Cards for Alexa A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
  • 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Display Cards for Alexa Weather, to-do and lists, calendars, and other Alexa skills Now Playing for media
  • 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Display Cards: Flow & delivery “Alexa, who is Usain Bolt?” SpeechRecognizer.Recognize
  • 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Display Cards: Flow & delivery Alexa TTS: “Usain St Leo Bolt…” SpeechSynthesizer.Speak Alexa sends a RenderTemplate directive with the JSON for your request. TemplateRuntime.RenderTemplate
  • 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RenderTemplate directive • BodyTemplate1: text-only visual metadata • BodyTemplate2: text and a single image • ListTemplate1: to-do, shopping, and calendar lists • WeatherTemplate: weather forecast RenderPlayerInfo directive • Now Playing info TemplateRuntime interface
  • 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. BodyTemplate2 Example
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Voice chrome & interactions on TV
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Live demo
  • 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Code-based linking A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Problem Onscreen keyboards are bad news. Very bad news if people are trying to type in credentials.
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Solution: CBL
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CBL flow
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Alexa smart home & video skills A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ACTIONS SH AV Smart home skills for entertainment devices
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Smart Home for AV interfaces Operation Capability interface Turn things on and off Alexa.PowerController Change the channel on a device Alexa.ChannelController Change the input of a playback device Alexa.InputController Control the playback of device; fast forward, rewind, and pause Alexa.PlaybackController Change the volume in incremental steps Alexa.StepSpeaker Change the volume to anywhere on a continuous range Alexa.Speaker Indicate an error has occurred Alexa.ErrorResponse
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VIDEOSH AV APIs Video Skill API
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hisense TV demonstration A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hisense demo
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you! A L X 3 1 8 : D e s i g n i n g m u l t i - m o d a l d e v i c e s w i t h A V S Visit the Alexa developer portal for more: AVS: Alexa Voice Services developer.amazon.com/avs AVS: Display Cards developer.amazon.com/alexa-voice-service/gui AVS: Code-based linking developer.amazon.com/docs/alexa-voice-service/code-based- linking-other-platforms.html AVS: Design Guide developer.amazon.com/docs/alexa-voice-service/ux-design- overview.html#displaycards ASK: Smart home for entertainment developer.amazon.com/docs/smarthome/build-smart-home-skills- for-entertainment-devices.html ASK: Video Skills developer.amazon.com/alexa-skills-kit/video-content
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you!