SlideShare a Scribd company logo
#MUXL
Designing	Voice	Interactions	with	Alexa	
Hosted	by	Amazon	
6th	April		
#MUXL
2	Day	Hackathon	with	Orange	&	Oracle	
Designing	Interactive	Dialogues	for	Next	Gen	Messaging	
27th / 28th April
#MUXL
Foundation	Course	in	UX	&	UCD	
8	Weeks,	Evening	Classes,	In-Person	
Starting	May	2018	
Intermediate	Course	in	UX	
6	Weeks,	Afternoon	or	Evening	Classes,	In-Person	
Starting	April	2018
#MUXL
Multi-lingual	chatbots

Tourism	bot	supporting	any	language	
(almost	☺)
Linus	Hakansson
@OracleLinus	
linkedin.com/in/linushakansson/
2
3
4
Málaga	Tourism	Bot
• Support	locals	and	tourists	from	
any	country	
– Tourist	office	opening	hours	
– Hospitals,	stadiums	and	museums
• Problems:	
– I	don’t	speak	a	lot	of	languages	
– I	am	the	only	developer	
– I	need	it	now
5
“When	do	you	open	tomorrow?”
6
Intent Utterances	(training	phrase)
“Are	you	closed	today?”
“What	are	your	opening	
hours?”
“What	time	do	you	open?”
“Closing	time?”
Opening	Hours
Places
7
Intent
“Are	you	closed	today?”
“What	are	your	opening	
hours?”
“What	time	do	you	open?”
“Closing	time?”
Opening	Hours
Places
Entity	(slot)
Date
“When	do	you	open	tomorrow?”
Utterances	(training	phrase)
Decision	#1:	How	to	identify	the	user’s	language?
• First-level	bulleted	text	is	Calibri	28	pt	
– Second-level	text	(press	tab	key)	is	24	pt	
• Third-level	text	(press	tab	key)	is	20	pt	
– Fourth-level	text	(press	tab	key)	is	18	pt	
• Calibri	is	the	only	font	used	in	the	template	
• All	bulleted	text	is	sentence	case	(capitalize	first	letter	of	
first	word)
8
Decision	#1:	How	to	identify	the	user’s	language?
9
Decision	#2:	How	will	our	AI	understand	all	languages?
10
Decision	#2:	How	will	our	AI	understand	all	languages?
11
1	AI	model	per	language	
• I	need	to	understand	and	translate	
intents/entities	
• How	is	my	platform	support	for	all	
languages?	
• A	lot	of	training
Use	translation	engine	
• Train	AI	in	English	(intent/entities)	
• Translation	engine	translates	input	to	
English	
• Run	English	translation	against	AI
Decision	#3:	How	to	respond	in	user’s	language?
12
Decision	#3:	How	to	respond	in	user’s	language?
13
Language	files	or	resources	
• Lots	of	knowledge	and	work	
• Accurate	and	controlled
Use	translation	engine	
• Support	many	languages	without	any	
effort	
• Use	translation	engine	to	translate	
English	to	the	identified	language	
• We	are	relying	on	a	translation	engine
Decision	#4:	What	if	we	can’t	help	the	user?
14
Decision	#4:	What	if	we	can’t	help	the	user?
15
Option	to	hand-over	to	human	
• Don’t	let	the	user	get	frustrated	
• Let	human	perform	sensitive	tasks
Clarify	current	responder	
• Who/what	is	the	user	talking	to?	
• Avoid	“uncanny	valley”	effect
16
Málaga	Tourism	Bot
• AI	trained	on	English	
• Identify	language	using	translation	engine	
• Translate	input	to	English	using	translation	engine	
• Understand	the	translated	input
16
Málaga	Tourism	Bot
• Office	opening	hours	(Sensitive)	
– Respond	using	translated	strings	
– Revert	to	English	if	unsupported
17
• Hospitals,	stadiums	and	museums	
(Not	sensitive)	
– Respond	using	translation	engine
18
Málaga	Tourism	Bot
• Hand-over	to	human	
– If	we	can’t	understand	user	
– If	user	gets	frustrated	
• Human	can	see	conversation	log	
• Human-to-human	chat
18
1919
m.me/MeetupLanguageBot
• Examples:	
– Are	you	open	on	New	Year's	
Day?	
– Where	is	the	hospital?	
– How	to	find	the	stadium?	
– Don’t	complain	to	the	bot,	you	
are	not	allowed	to	speak	to	the	
human	agent	;)

More Related Content

More from MobileUXLondon

More from MobileUXLondon (20)

Humanity Centred Design
Humanity Centred DesignHumanity Centred Design
Humanity Centred Design
 
Design and Climate
Design and ClimateDesign and Climate
Design and Climate
 
Sustainable UX For Everyone
Sustainable UX For EveryoneSustainable UX For Everyone
Sustainable UX For Everyone
 
Design in the Anthropocene
Design in the AnthropoceneDesign in the Anthropocene
Design in the Anthropocene
 
Tokyo War Story
Tokyo War StoryTokyo War Story
Tokyo War Story
 
Global Design Systems at Condé Nast International
Global Design Systems at Condé Nast InternationalGlobal Design Systems at Condé Nast International
Global Design Systems at Condé Nast International
 
Making The Case For Localisation
Making The Case For LocalisationMaking The Case For Localisation
Making The Case For Localisation
 
Taking our first leap into Voice Design - Making an Educake
Taking our first leap into Voice Design - Making an EducakeTaking our first leap into Voice Design - Making an Educake
Taking our first leap into Voice Design - Making an Educake
 
Personality for Voice
Personality for VoicePersonality for Voice
Personality for Voice
 
What's happening in the world of voice
What's happening in the world of voiceWhat's happening in the world of voice
What's happening in the world of voice
 
The need for emotionally intelligent conversational design
The need for emotionally intelligent conversational designThe need for emotionally intelligent conversational design
The need for emotionally intelligent conversational design
 
5 rules for delivering more accessible projects, and 5 more you might want to...
5 rules for delivering more accessible projects, and 5 more you might want to...5 rules for delivering more accessible projects, and 5 more you might want to...
5 rules for delivering more accessible projects, and 5 more you might want to...
 
7 tips to push and maintain the accessibility agenda in your organisation
7 tips to push and maintain the accessibility agenda in your organisation7 tips to push and maintain the accessibility agenda in your organisation
7 tips to push and maintain the accessibility agenda in your organisation
 
Building the most accessible and inclusive FTSE company: the Barclays playbook
Building the most accessible and inclusive FTSE company: the Barclays playbook Building the most accessible and inclusive FTSE company: the Barclays playbook
Building the most accessible and inclusive FTSE company: the Barclays playbook
 
Why accessibility is important and how to convince your organisation
Why accessibility is important and how to convince your organisationWhy accessibility is important and how to convince your organisation
Why accessibility is important and how to convince your organisation
 
Let’s all be friends! How great design relies on collaboration
Let’s all be friends! How great design relies on collaborationLet’s all be friends! How great design relies on collaboration
Let’s all be friends! How great design relies on collaboration
 
How to lead UX and enjoy it
How to lead UX and enjoy itHow to lead UX and enjoy it
How to lead UX and enjoy it
 
Trouble in the team: techniques to solve conflicts
Trouble in the team: techniques to solve conflicts Trouble in the team: techniques to solve conflicts
Trouble in the team: techniques to solve conflicts
 
Calm Team Strategies
Calm Team StrategiesCalm Team Strategies
Calm Team Strategies
 
How to build, inspire and keep a successful design team
How to build, inspire and keep a successful design teamHow to build, inspire and keep a successful design team
How to build, inspire and keep a successful design team
 

Recently uploaded

Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 

Designing for Conversations & Messaging - Mobile UX London with Oracle - Linus-Multi-language bots