SlideShare a Scribd company logo
1 of 34
voice is the new controller
Mark Bate
@markbate | alexa.design/games
June 2018
M a r k B a t e
Hallöchen!
Alexa
USA, UK, Germany, France, India, Japan, Canada, Australia, & New
Zealand
And 80+ new countries now support Alexa in English
A l e x a - E n a b l e d D e v i c e s
A l e x a – E n a b l e d D e v i c e s
Ambient Sounds:
Ocean Sounds
RuneScape Quests Recipedia Deutsche Bahn
Alexa Skills
Speech
Alexa Service
Automatic Speech
Recognition
Natural Language
Understanding
Text To Speech
Intent Events
AWS
Lambda
(your skill
code)
OVERVIEW OF HOW ALEXA WORKS
Card /
RenderTemplate
Voice User Interface Programming Logic
+
developer.amazon.com aws.amazon.com
Intents
Utterances
Slots
Alexa Skill - Requests
Alexa Skill – Requests
{
...
“session“ : {}, // session id, app id, session attributes
“context“ : {}, // user id, device attributes
"request": {
"type": "LaunchRequest", // intent to call
"requestId": "amzn1.echo-api.request.000-longnumbergoeshere",
"timestamp": "2018-04-25T14:25:56Z",
"locale": “de-DE" // user‘s language
}
...
}
Alexa Skill - Responses
Alexa Skill – Responses
{
...
"sessionAttributes": {}, // set session attributes
"response": {
"outputSpeech": { // text/audio to say to user
"type": "PlainText",
"text": “Hi, welcome to awesome skill. What can I help you with?"
},
"card": {}, // visuals to send back
"reprompt": {} // if user doesn‘t respond
"shouldEndSession": false // open mic for user
}
}
Voice First
Cognitive Load
Conversational Content
Speech
D E S I G N I N G F O R V O I C E
alexa.design/guide
alexa.design/guide
M U L T I - M O D A L I S V O I C E F I R S T
alexa.design/guide
A L E X A V O I C E
D E S I G N G U I D E
W h a t k i n d o f g a m e s a r e
d e v e l o p e r s c r e a t i n g n o w o n A l e x a ?
Jeopardy! 20 Questions Song Quiz Akinator
Casual Games
The Magic Door RuneScape Quests:
One PIercing Note
Der Fall Rachel:
Schicksal einer KI
Path of Discovery:
Europa
Interactive Adventures
Destiny 2: Ghost Call of Duty Craft Helper Steam Deals
Game Helpers / Reference
https://www.amazon.co.uk/dp/B077J92PYC
Bandit Buttons Don‘t Cut That Wire Hanagram Trivial Pursuit Tap
Gadgets
NEW CAPABILITIES FOR SKILLS
Independent
Input Event Channel
Session Extension Mic Control
Overview Directives Design Labs
ARCHITECTURE - INPUT
Alexa Service
ASR/NLU
GameEngine
Intent Events
AWS
Lambda
(your skill
code)
GameEngine
Events
Overview Directives Design Labs
ARCHITECTURE - OUTPUT
Alexa Service
Custom Skills API
GameEngine /
GadgetController
Response +
Echo Device
Directives
AWS
Lambda
(your skill
code)
Gadget
Directives
Overview Directives Design Labs
GADGET CONTROLLER DIRECTIVE
• Sequence
• Gadget IDs
• Trigger
Color
Duration
• Repeat
Overview Directives Design Labs
GAME ENGINE DIRECTIVE
T H R E E _ B L U E S
Overview Directives Design Labs
DESIGNING FOR VOICE + BUTTONS
• Remember – voice first!
• Understand the input handler
• Sound design
Overview Directives Design Labs
DESIGNING FOR VOICE + BUTTONS
• Don’t make animations too fast
• Make a user interaction flow chart
• Conversational memory
• Get your build process right
• Iterative testing
Overview Directives Design Labs
BUILDING FOR BUTTONS
• Check the docs
• Check the “Don’t Cut That Wire”
teardown
Overview Directives Design Labs
v o i c e i s t h e n e w c o n t r o l l e r
a l e x a . d e s i g n / g a m e s
a l e x a . d e s i g n / g e r m a n y
@markbate

More Related Content

What's hot

Alexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZONAlexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZONAnusha Deva
 
Alexa Basic Introduction
Alexa Basic IntroductionAlexa Basic Introduction
Alexa Basic IntroductionPardeep jain
 
Speak Up! Build an Alexa Skill for a Cause
 Speak Up! Build an Alexa Skill for a Cause Speak Up! Build an Alexa Skill for a Cause
Speak Up! Build an Alexa Skill for a CauseNikki Clark
 
Alexa skill development
Alexa skill developmentAlexa skill development
Alexa skill developmentGoran Vuksic
 
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)Amazon Web Services
 
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...Amazon Web Services
 
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski Amazon
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski AmazonArtificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski Amazon
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski AmazonAssist
 
Voice interface project
Voice interface projectVoice interface project
Voice interface projectJoão Ricardo
 
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...Amazon Web Services
 
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...Amazon Web Services
 
Alexa introduction
Alexa introductionAlexa introduction
Alexa introductionPardeep jain
 

What's hot (14)

Alexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZONAlexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZON
 
Alexa Basic Introduction
Alexa Basic IntroductionAlexa Basic Introduction
Alexa Basic Introduction
 
Having fun with alexa
Having fun with alexaHaving fun with alexa
Having fun with alexa
 
Speak Up! Build an Alexa Skill for a Cause
 Speak Up! Build an Alexa Skill for a Cause Speak Up! Build an Alexa Skill for a Cause
Speak Up! Build an Alexa Skill for a Cause
 
Alexa skill development
Alexa skill developmentAlexa skill development
Alexa skill development
 
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
AWS re:Invent 2016: Building a Smarter Home with Alexa(ALX303)
 
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...
AWS re:Invent 2016: How Capital One Built a Voice-Based Banking Skill for Ama...
 
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski Amazon
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski AmazonArtificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski Amazon
Artificial Intelligence at Work - Assist Workshop 2016 - Dave Isbitski Amazon
 
Voice interface project
Voice interface projectVoice interface project
Voice interface project
 
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
AWS re:Invent 2016: State of the Union: Amazon Alexa and Recent Advances in C...
 
Amazon alexa
Amazon alexaAmazon alexa
Amazon alexa
 
Babygeddon presentation
Babygeddon presentationBabygeddon presentation
Babygeddon presentation
 
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
AWS re:Invent 2016: Workshop: Build an Alexa-Enabled Product with Raspberry P...
 
Alexa introduction
Alexa introductionAlexa introduction
Alexa introduction
 

Similar to voice is the new controller

Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding WorkshopDigital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding WorkshopDinah Barrett
 
Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101Amazon Web Services
 
Voice enable all the things with Alexa
Voice enable all the things with AlexaVoice enable all the things with Alexa
Voice enable all the things with AlexaMark Bate
 
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018 AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018 Amazon Web Services Korea
 
Hackster DFW - Amazon Echo Workshop
Hackster DFW - Amazon Echo WorkshopHackster DFW - Amazon Echo Workshop
Hackster DFW - Amazon Echo WorkshopRon Dagdag
 
Maximising the Customer Experience with Amazon Connect and AI Services
Maximising the Customer Experience with Amazon Connect and AI ServicesMaximising the Customer Experience with Amazon Connect and AI Services
Maximising the Customer Experience with Amazon Connect and AI ServicesAmazon Web Services
 
Amazon alexa - building custom skills
Amazon alexa - building custom skillsAmazon alexa - building custom skills
Amazon alexa - building custom skillsAniruddha Chakrabarti
 
Design and Develop Alexa Skills - Codemotion Rome 2019
Design and Develop Alexa Skills - Codemotion Rome 2019Design and Develop Alexa Skills - Codemotion Rome 2019
Design and Develop Alexa Skills - Codemotion Rome 2019Aleanan
 
IT Camp 2019: How to build your first Alexa skill in under one hour
IT Camp 2019: How to build your first Alexa skill in under one hourIT Camp 2019: How to build your first Alexa skill in under one hour
IT Camp 2019: How to build your first Alexa skill in under one hourIonut Balan
 
Building Next Level Voice Games with Alexa
Building Next Level Voice Games with AlexaBuilding Next Level Voice Games with Alexa
Building Next Level Voice Games with AlexaMark Bate
 
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...Amazon Web Services
 
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...Amazon Web Services
 
Get Started Developing with Alexa and Drupal
Get Started Developing with Alexa and DrupalGet Started Developing with Alexa and Drupal
Get Started Developing with Alexa and DrupalAmber Matz
 
BDA310 An Introduction to the AI services at AWS
BDA310 An Introduction to the AI services at AWSBDA310 An Introduction to the AI services at AWS
BDA310 An Introduction to the AI services at AWSAmazon Web Services
 
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Codemotion
 
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Codemotion
 
Alexa, lets make a skill
Alexa, lets make a skillAlexa, lets make a skill
Alexa, lets make a skillMichael Peacock
 
The Future Of Responsive Design Standards
The Future Of Responsive Design StandardsThe Future Of Responsive Design Standards
The Future Of Responsive Design StandardsDen Odell
 

Similar to voice is the new controller (20)

Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding WorkshopDigital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
Digital Muse “Girl Tech Fest - AWS Alexa Skills Coding Workshop
 
Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101Alexa bootcamp - Skill building 101
Alexa bootcamp - Skill building 101
 
Alexa for Developers
Alexa for DevelopersAlexa for Developers
Alexa for Developers
 
Voice enable all the things with Alexa
Voice enable all the things with AlexaVoice enable all the things with Alexa
Voice enable all the things with Alexa
 
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018 AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018
AWS와 Alexa 음성 인식 플랫폼을 통한 비즈니스 기회::윤석찬::AWS Summit Seoul 2018
 
Hackster DFW - Amazon Echo Workshop
Hackster DFW - Amazon Echo WorkshopHackster DFW - Amazon Echo Workshop
Hackster DFW - Amazon Echo Workshop
 
Maximising the Customer Experience with Amazon Connect and AI Services
Maximising the Customer Experience with Amazon Connect and AI ServicesMaximising the Customer Experience with Amazon Connect and AI Services
Maximising the Customer Experience with Amazon Connect and AI Services
 
Amazon alexa - building custom skills
Amazon alexa - building custom skillsAmazon alexa - building custom skills
Amazon alexa - building custom skills
 
Design and Develop Alexa Skills - Codemotion Rome 2019
Design and Develop Alexa Skills - Codemotion Rome 2019Design and Develop Alexa Skills - Codemotion Rome 2019
Design and Develop Alexa Skills - Codemotion Rome 2019
 
IT Camp 2019: How to build your first Alexa skill in under one hour
IT Camp 2019: How to build your first Alexa skill in under one hourIT Camp 2019: How to build your first Alexa skill in under one hour
IT Camp 2019: How to build your first Alexa skill in under one hour
 
Building Next Level Voice Games with Alexa
Building Next Level Voice Games with AlexaBuilding Next Level Voice Games with Alexa
Building Next Level Voice Games with Alexa
 
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
AWS re:Invent 2016: Workshop: Creating Voice Experiences with Alexa Skills: F...
 
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...
Activision Blizzard: Giving Call of Duty Gamers an Edge with Alexa and AWS (G...
 
Get Started Developing with Alexa and Drupal
Get Started Developing with Alexa and DrupalGet Started Developing with Alexa and Drupal
Get Started Developing with Alexa and Drupal
 
Alexa voice bot
Alexa voice botAlexa voice bot
Alexa voice bot
 
BDA310 An Introduction to the AI services at AWS
BDA310 An Introduction to the AI services at AWSBDA310 An Introduction to the AI services at AWS
BDA310 An Introduction to the AI services at AWS
 
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
 
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
Mark Bate - Building Next Level Voice Games with Alexa - Codemotion Berlin 2018
 
Alexa, lets make a skill
Alexa, lets make a skillAlexa, lets make a skill
Alexa, lets make a skill
 
The Future Of Responsive Design Standards
The Future Of Responsive Design StandardsThe Future Of Responsive Design Standards
The Future Of Responsive Design Standards
 

More from Mark Bate

Game Analytics Nov 2019
Game Analytics Nov 2019Game Analytics Nov 2019
Game Analytics Nov 2019Mark Bate
 
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...Mark Bate
 
Simple Security for Startups
Simple Security for StartupsSimple Security for Startups
Simple Security for StartupsMark Bate
 
AWS re:Invent re:Cap 2015
AWS re:Invent re:Cap 2015AWS re:Invent re:Cap 2015
AWS re:Invent re:Cap 2015Mark Bate
 
Amazon API Gateway
Amazon API GatewayAmazon API Gateway
Amazon API GatewayMark Bate
 
Amazon API Gateway
Amazon API GatewayAmazon API Gateway
Amazon API GatewayMark Bate
 

More from Mark Bate (6)

Game Analytics Nov 2019
Game Analytics Nov 2019Game Analytics Nov 2019
Game Analytics Nov 2019
 
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...
AWS re:Invent 2017 ALX301 - 5 AWS services that will supercharge your Alexa s...
 
Simple Security for Startups
Simple Security for StartupsSimple Security for Startups
Simple Security for Startups
 
AWS re:Invent re:Cap 2015
AWS re:Invent re:Cap 2015AWS re:Invent re:Cap 2015
AWS re:Invent re:Cap 2015
 
Amazon API Gateway
Amazon API GatewayAmazon API Gateway
Amazon API Gateway
 
Amazon API Gateway
Amazon API GatewayAmazon API Gateway
Amazon API Gateway
 

Recently uploaded

Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 

Recently uploaded (20)

Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 

voice is the new controller

  • 1. voice is the new controller Mark Bate @markbate | alexa.design/games June 2018
  • 2. M a r k B a t e Hallöchen!
  • 4. USA, UK, Germany, France, India, Japan, Canada, Australia, & New Zealand
  • 5. And 80+ new countries now support Alexa in English
  • 6.
  • 7. A l e x a - E n a b l e d D e v i c e s
  • 8. A l e x a – E n a b l e d D e v i c e s
  • 9. Ambient Sounds: Ocean Sounds RuneScape Quests Recipedia Deutsche Bahn Alexa Skills
  • 10. Speech Alexa Service Automatic Speech Recognition Natural Language Understanding Text To Speech Intent Events AWS Lambda (your skill code) OVERVIEW OF HOW ALEXA WORKS Card / RenderTemplate
  • 11. Voice User Interface Programming Logic + developer.amazon.com aws.amazon.com Intents Utterances Slots
  • 12. Alexa Skill - Requests
  • 13. Alexa Skill – Requests { ... “session“ : {}, // session id, app id, session attributes “context“ : {}, // user id, device attributes "request": { "type": "LaunchRequest", // intent to call "requestId": "amzn1.echo-api.request.000-longnumbergoeshere", "timestamp": "2018-04-25T14:25:56Z", "locale": “de-DE" // user‘s language } ... }
  • 14. Alexa Skill - Responses
  • 15. Alexa Skill – Responses { ... "sessionAttributes": {}, // set session attributes "response": { "outputSpeech": { // text/audio to say to user "type": "PlainText", "text": “Hi, welcome to awesome skill. What can I help you with?" }, "card": {}, // visuals to send back "reprompt": {} // if user doesn‘t respond "shouldEndSession": false // open mic for user } }
  • 16. Voice First Cognitive Load Conversational Content Speech D E S I G N I N G F O R V O I C E alexa.design/guide
  • 17. alexa.design/guide M U L T I - M O D A L I S V O I C E F I R S T
  • 18. alexa.design/guide A L E X A V O I C E D E S I G N G U I D E
  • 19. W h a t k i n d o f g a m e s a r e d e v e l o p e r s c r e a t i n g n o w o n A l e x a ?
  • 20. Jeopardy! 20 Questions Song Quiz Akinator Casual Games
  • 21. The Magic Door RuneScape Quests: One PIercing Note Der Fall Rachel: Schicksal einer KI Path of Discovery: Europa Interactive Adventures
  • 22. Destiny 2: Ghost Call of Duty Craft Helper Steam Deals Game Helpers / Reference
  • 24.
  • 25. Bandit Buttons Don‘t Cut That Wire Hanagram Trivial Pursuit Tap Gadgets
  • 26. NEW CAPABILITIES FOR SKILLS Independent Input Event Channel Session Extension Mic Control Overview Directives Design Labs
  • 27. ARCHITECTURE - INPUT Alexa Service ASR/NLU GameEngine Intent Events AWS Lambda (your skill code) GameEngine Events Overview Directives Design Labs
  • 28. ARCHITECTURE - OUTPUT Alexa Service Custom Skills API GameEngine / GadgetController Response + Echo Device Directives AWS Lambda (your skill code) Gadget Directives Overview Directives Design Labs
  • 29. GADGET CONTROLLER DIRECTIVE • Sequence • Gadget IDs • Trigger Color Duration • Repeat Overview Directives Design Labs
  • 30. GAME ENGINE DIRECTIVE T H R E E _ B L U E S Overview Directives Design Labs
  • 31. DESIGNING FOR VOICE + BUTTONS • Remember – voice first! • Understand the input handler • Sound design Overview Directives Design Labs
  • 32. DESIGNING FOR VOICE + BUTTONS • Don’t make animations too fast • Make a user interaction flow chart • Conversational memory • Get your build process right • Iterative testing Overview Directives Design Labs
  • 33. BUILDING FOR BUTTONS • Check the docs • Check the “Don’t Cut That Wire” teardown Overview Directives Design Labs
  • 34. v o i c e i s t h e n e w c o n t r o l l e r a l e x a . d e s i g n / g a m e s a l e x a . d e s i g n / g e r m a n y @markbate