SlideShare a Scribd company logo
1 of 51
Download to read offline
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI Summit
Delivering on the Promise of AI Together
Rohit Prasad, Alexa AI
ROHIT PRASAD
VICE PRESIDENT & HEAD SCIENTIST, ALEXA AI
DELIVERING ON THE
PROMISE OF AI, TOGETHER
AmazonGo PrimeAir AWS AI
Ambient Computing Powered By Conversational AI
Available in
80+ countries
Fourteen localized experiences
Millions of
customers
Towards Alexa Everywhere
WEATHER REPORTS
TRAFFIC
9AM
MUSIC
LUNCH DELIVERY
12PM
HOMEWORK HELP
RECIPE RESEARCH
3PM
COOKING TIMERS
MUSIC
6PM
150,000+ Five-Star Reviews
“I love Alexa! She’s used daily for one
thing or another, it's so simple to set
alarms, timers, play music, ask
questions, make phone calls, text
someone on my contact list, even play
games…”
“My mom is now almost 95 and she
has short term memory dementia... I
can now "Drop-in" every day and share
some face time with her, visit with her
grand daughter, see the dog whom she
LOVES, and just make her smile.”
- Ed R.
- KG
Character Mode GUI Web Mobile
1970s 1980s 1990s 2000s
Automatic Speech
Recognition
Wake Word
Detection
Alexa
Voice
Service
Text-to-speech Natural Language
Understanding
Our Promise To Customers: Smarter Alexa
NaturalSelf-learningCompetency Context-aware
2015 2016 20172014 2018
COMPETENCY
13 skills
50,000+ SKILLS
Democratization of Conversational AI
2015 2016 20172014 2018
Error rate
13 skills
50,000+ SKILLSCOMPETENCY
ML Model
Labeled Corpus Unlabeled Data
Predictions
Targeted Data
Selection
ACTIVE LEARNING
Restaurant, weather data Recipe data
Transfer learning
ALEXA LEARNS FROM HER OWN TASKS
Context-aware
Discourse Memory
NLU Utterance
Level Interpretation
Named Entity Recognition
Intent Classification
NLU Conversational
Level Interpretation
Intent Carryover LSTM
Entity Carryover LSTM
INITIAL INTERPRETATION
Discourse History
NLU Interpretation
Update
CONTEXTUAL INTERPRETATION
FINAL INTERPRETATION
“What’s the weather
like in LA?”
“What about tomorrow?”
PROBABILISTIC CONTEXT CARRYOVER
Discourse Memory
Whisper
WHISPER MODE
LSTM
Whisper
Customer’s Utterance
Normal
Alexa response Text to Speech Whispered Audio
“Alexa, I am
leaving.”
Context Beyond Words
ALEXA LEARNS IMPORTANT SOUNDS
Long Short-Term Memory (LSTM) Multi-task Learning
Smoke Alarm Glass Breaking
ACOUSTIC EVENT DETECTION
Discourse Memory
Whisper
Acoustic Events
Hunches
Self-learning
“Play Sirius
XM Chill.”
Automatic Equivalence Class Learning
ALEXA CAN LEARN FROM MISTAKES
“Play Sirius
XM Chill.”
“Play Channel 53
on Sirius XM.”
AUTOMATIC EQUIVALENCE CLASS LEARNING
Sirius XM ChillAutomatic Error
Detection
Automatic Query
Reformulation
Implicit or Explicit
Feedback
Sirius Channel 53
Sirius XM ChillAutomatic Error
Detection
Automatic Query
Reformulation
Implicit or Explicit
Feedback
Sirius Channel 53
“Play Sirius
XM Chill.”
“Play Channel 53
on Sirius XM.”
AUTOMATIC EQUIVALENCE CLASS LEARNING
Natural
Multi-step Request In One Shot
“Alexa, add strawberries, peanut butter, and jelly to my shopping list.”
Multi-step request in one shot.
AFTERBEFORE
MULTIPLE INTENTS IN ONE SHOT
“Play Hootie and the Blowfish
AND turn on the bedroom lights.”
Play Hootie and the Blowfish Turn on the bedroom lightsAND
COORDINATION
USER REQUEST 1 ELEMENT ELEMENT USER REQUEST 2COORDINATOR
Alexa Infers What Customers Want
“Alexa, get
me a car.”
Skill metadata
User preferences
ASR
NLU
Shortlister
NLU
k-best skills k hypotheses
Contextual
Ranking
Skill
Contextual
Signals
“Ask Uber to get me a car.”
NATURAL SKILL INTERACTION
“Alexa,
open
Cortana.”
Working Together
“Hey
Cortana,
open
Alexa.”
James Vlahos – Wired Magazine
“Twenty minutes of small talk with a computer
isn’t just a moonshot, it’s a trip to Mars.”
Alexa Prize 2018
75 BILLION connected devices
BY 2025…
“What should I
make for dinner?”
“What is the
weather like
in Tahoe this
weekend?
“Suggest a
spring vacation
destination.”
THE GOOD WE CAN DO WITH AI
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Rohit Prasad

More Related Content

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Protect your applications from DDoS/BOT & Advanced Attacks
Protect your applications from DDoS/BOT & Advanced AttacksProtect your applications from DDoS/BOT & Advanced Attacks
Protect your applications from DDoS/BOT & Advanced Attacks
Amazon Web Services
 
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Amazon Web Services
 

More from Amazon Web Services (20)

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWS
 
AWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei server
 
Crea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSightCrea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSight
 
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker AutopilotCostruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
 
Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows
 
La tua organizzazione è pronta per adottare una strategia di cloud ibrido?
La tua organizzazione è pronta per adottare una strategia di cloud ibrido?La tua organizzazione è pronta per adottare una strategia di cloud ibrido?
La tua organizzazione è pronta per adottare una strategia di cloud ibrido?
 
Protect your applications from DDoS/BOT & Advanced Attacks
Protect your applications from DDoS/BOT & Advanced AttacksProtect your applications from DDoS/BOT & Advanced Attacks
Protect your applications from DDoS/BOT & Advanced Attacks
 
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
 

Delivering on the Promise of AI Together (AIS301) - AWS re:Invent 2018