The document discusses voice recognition and synthesis technologies for building a cross-device personal assistant. It describes how speech input is processed through automatic speech recognition (ASR), natural language understanding (NLU) and text-to-speech (TTS) to have conversations. It outlines the characteristics of a personalized assistant experience across multiple devices and users. Finally, it discusses how to integrate speech technologies into wearables using microphones and speech APIs.

1. Voice Recognition and Synthesis
A Cross Device Personal Assistant Experience
Sheetal Guttigoli

2. 2
●What is the Voice experience?
●An always available, multi-user, personalized, cross-
device experience
●Speech output
●Speech is accessible
» VIBE.AI
Sensory: Voice
Content
© Copyright 2016 VoiceBox Technologies Corporation - Confidential @sheetalg7 @VoiceBox_Tech

3. 3
Speech Recognition and Synthesis
What is the Voice Experience?
@sheetalg7 @VoiceBox_Tech

4. ASR
TTS
What’s the
weather like for
my ride?
NLU
What’s the weather like for my ride?
server
Weather Provider
“What’s the weather like for my ride?”
It’s sunny today,
with a temperature
of 52 . Have a
nice ride!
How does voice technology work?

5. 5© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Multi Device
Multi User
Cross Device
Personalized
Proactive Information
Always Available
Characteristics
Personal Assistant Experience

6. 6
A Vision for a
Voice Interface
An Always
Available
Experience
© Copyright 2016 VoiceBox Technologies
Corporation - Confidential

7. Context Management
A Cross Device Experience
“ Traffic on the way
to Kings is heavy!”
7© Copyright 2015 VoiceBox Technologies Corporation - Confidential
On the go In Car At Home
Alert: “You have a
Facebook message
from Jim”
Porch lights
turned on
“ Let Me Know If I Get
a message From Jim”“ Make a Dinner
Reservation at Kings
Café for 2 at 7pm”
“ Turn porch
lights on”
“ Play Some
Jazz ”
“Continue
Playing”
@sheetalg7 @VoiceBox_Tech

8. 8
Across Multiple ‘Known’ Users
A Personalized Experience
© Copyright 2016 VoiceBox Technologies Corporation - Confidential
“Alexa, we have a problem…”
Read me my
messages…
Read me my
messages…
Read me my
messages…
@sheetalg7 @VoiceBox_Tech

9. 9
Who would you like to be your Personal Assistant?
The Personable Assistant
© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Pepper Potts
Jarvis
People have been enamored with distinctive assistant characters throughout the years

10. 10
How Appealing Are Each Of The Voice Characters
Voice Character Appeal
Top 3
• Male Best Friend
• Male Butler
• Female Best Friend
Top 3
• Female Best Friend
• Male Butler
• Female Robot

11. 11
Favorite Voices To Replace Current Voice
Are There Any Voice Characters You Would Prefer To Use In Place Of Your Current Device/Car Voice?
Top 3
• Male Butler
• Male Best Friend
• Hip Cool Female
Top 3
• Female Robot
• Male Butler
• Male Robot

12. 12
Modern Female Robot
Personal Assistant
© Copyright 2016 VoiceBox Technologies Corporation - Confidential
The Female Robot is modern,
sophisticated and graceful. She knows
she is a robot and is programmed to
assist, but she also possesses a greater
awareness and this is reflected in her
speech and humor.
Defining Characteristics
• IS: precise, analytical, logical,
sophisticated, suave, and proud of her
advanced technology
• IS NOT: common, subservient, base,
or stupid
• MAY occasionally be: sarcastic,
haughty, flirty, condescending, and
bemused at human foibles
@sheetalg7 @VoiceBox_Tech

13. 13© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Voice Characters Respond With Personality
Home
Automation -
Wakeup
“Good morning to you.
Your morning coffee is
brewing and I’ve turned
the heat on.”
“Greetings. Caffeinated
beverage ready for your
consumption. Room
temperature raised to
sixty-seven degrees.”
“Rise and shine, sleepyhead.
Time to start the day! I’ve
started the coffee maker and
turned on the heat just the
way you like it.”
“What’s the weather
like for my run?”
“Grand idea. A brisk run
is good for the lungs. At
the moment it’s sunny
and 56 degrees.”
“Accessing weather data.
Current temperature 56
degrees with sunny skies.
Excellent conditions for
physical exercise.”
“Sure. Let’s see, it’s 56
degrees outside and the
sun is shining. Have a great
run!”
“Set a wake-up
alarm for five
AM.”
“I set your wake-up
alarm for five AM. Rising
with the sun are we?”
“Alarm set. Sleep cycle
will be terminated at five
am with loud noise.”
“Five AM? Really? Okay,
make sure you get to bed
early and get a good
night’s rest.”
@sheetalg7 @VoiceBox_Tech

14. 14© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Voice Characters Respond With Personality
“What does my
afternoon look
like?”
“Your schedule is full this
afternoon, Sir. Barely a
moment to spare!”
“Accessing calendar.
Warning, free time
critically low. You have
meetings all afternoon.”
“Let me check your
schedule. Let’s see, looks
like you have a really busy
afternoon with four
meetings. I don’t know
how you do it.”
“Add 2NE1 to my
Playlist.”
“Certainly, the musical
group 2NE1 has been
added to your play list.”
“Accessing play lists.
Incorporating additional
musical artist: 2NE1.”
“Great, I was just
thinking that myself.
I’ve added 2NE1.”
“What’s the traffic
like this morning?”
“The traffic is dreadful. I
highly recommend you
add twenty minutes to
your morning commute.”
“Traffic conditions
unfavorable. Recommend
leaving seventeen
minutes earlier than
normal.”
“Yikes, it’s not looking
good out there. You
should probably leave 20
minutes early if you want
to get to work on time.”
@sheetalg7 @VoiceBox_Tech

15. 15
Easy access to Speech
How to integrate into Wearables
© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Microphones
Speech API
(VIBE.AI)
@sheetalg7 @VoiceBox_Tech

16. 16
VIBE.AI (The Speech AI interface)
© Copyright 2016 VoiceBox Technologies Corporation - Confidential http://developer.voicebox.com

17. 17© Copyright 2016 VoiceBox Technologies Corporation - Confidential
Thanks!
@sheetalg7 @VoiceBox_Tech