Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Google Assistant!
Why? How?
UX Next
Palo Alto 2017
+GreenIdo
@GreenIdo
On your watch On your phone At home In your car
Ready to
help across
100M+
devices
Location & Context awareness
Knowledge Graph
Identity
Payments
Structured Data Markup
Natural Language Understanding
Machi...
Voice Typing Tap Google Lens
Coming soon
A growing
audience:
devices
Google Home / Mobile device — The surface to
interact with the Assistant.
The Google Assistant — A conversation
between yo...
“OK Google,
talk to...”
Ok Google, talk
to Personal Chef
Sure, here’s
Personal Chef
What are you
in the mood
for?
What protein
would you like
to u...
Well, it’s kind of cold outside, so I'd like
something to warm me up, like a hot
soup, and I want it fast.
I have some chi...
Assistant app
{ conversation
api request }
{ conversation
api response }
user input
app
response
“
Intent Matching — Match and categorize user utterances to
an intent.
Entity Extraction — Identify key words and phrases ...
Ok Google, talk
to Personal
Chef
Sure, here’s
Personal Chef
What are you
in the mood
for?
What protein
would you like
to u...
“Find me a recipe for
homemade cannoli”
User Says
Response
“Here’s the best
one I can find”
Webhook Entities:
homemade
can...
A magical experience
g.co/dev/ActionsDesign
Support different surface capabilities
https://developers.google.com/actions/assistant/surface-capabilities
AUDIO_OUTPUT S...
function simpleResponse (app) {
app.ask({
speech: 'Howdy! I can tell you fun facts about ' +
'almost any number, like 42. ...
function suggestionChips (app) {
app.ask(app.buildRichResponse()
.addSimpleResponse({
speech: 'Howdy! I can tell you fun f...
function basicCard (app) {
app.ask(app.buildRichResponse()
.addSimpleResponse('Math and prime numbers it is!')
.addBasicCa...
Lists and carousels for selection
https://developers.google.com/actions/assistant/responses
Used for easy
selection
<10 it...
Google Home Mobile Device
NAME Registered device user’s full name Registered device user’s full name
DEVICE_COARSE_LOCATIO...
Link an account to your OAuth2 server
https://developers.google.com/actions/identity/
Seamless account linking with Google...
Transact with the user
https://developers.google.com/actions/identity/
Build orders
Use Google provided payment
instrument...
Smart Home
developers.google.com/actions/smarthome/
What is the
temperature inside?
Turn off all the lights.
Dim the light...
Google Assistant SDK
developers.google.com/assistant/sdk
Reach users
In Dialogue Discovery:
Explicit Triggering
Ok Google, ask Personal Chef for a hot soup recipe
Trigger Phrase App Name
Deve...
Hey Google, I want to play a game.
Hey Google, tell me a joke.
In Dialogue Discovery:
Implicit Triggering
Hey Google, I wa...
Discovery in the Google
Assistant Directory
Link to your
Assistant App
From anywhere
Examples: ido-green.appspot.com/bots.html
Where do I start?
developers.google.com/actions
codelabs.developers.google.com
Actions on Google Developer Community
https://g.co/actionsdev
Actions on Google Developers
https://developers.google.com/a...
+GreenIdo
@GreenIdo
Thank you!
87% of B2C marketers in the US believe
chatbots and digital assistants will play a
significant role in marketing before 20...
Google Assistant - Why? How?
Google Assistant - Why? How?
Google Assistant - Why? How?
Google Assistant - Why? How?
Upcoming SlideShare
Loading in …5
×

Google Assistant - Why? How?

3,962 views

Published on

At Google, we believe the future is AI first, and we’re investing heavily in the fields of machine learning, speech recognition and language understanding. These technologies come together in the Google Assistant, which allows you to have a conversation with Google that helps you get things done.

Developers can build apps for the Google Assistant using Actions on Google and in these slides we will show you how you can do it and why you wish to be in this new platform.

Published in: Internet
  • Hey guys! Who wants to chat with me? More photos with me here 👉 http://www.bit.ly/katekoxx
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Google Assistant - Why? How?

  1. 1. Google Assistant! Why? How? UX Next Palo Alto 2017 +GreenIdo @GreenIdo
  2. 2. On your watch On your phone At home In your car
  3. 3. Ready to help across 100M+ devices
  4. 4. Location & Context awareness Knowledge Graph Identity Payments Structured Data Markup Natural Language Understanding Machine Learning Individual speech recognition Built on cutting edge Google tech
  5. 5. Voice Typing Tap Google Lens Coming soon
  6. 6. A growing audience: devices
  7. 7. Google Home / Mobile device — The surface to interact with the Assistant. The Google Assistant — A conversation between you and Google that helps you get things done in your world. Actions on Google — How developers can extend the assistant (via Assistant apps)
  8. 8. “OK Google, talk to...”
  9. 9. Ok Google, talk to Personal Chef Sure, here’s Personal Chef What are you in the mood for? What protein would you like to use? Speech to Text NLP Knowledge Graph ML Ranking User Profile Text to Speech Speech to Text Text to Speech ... Invoke Personal Chef action Parse query and generate response Well, it’s kind of cold outside, so I’d like...
  10. 10. Well, it’s kind of cold outside, so I'd like something to warm me up, like a hot soup, and I want it fast. I have some chicken, and also canned tomatoes
  11. 11. Assistant app { conversation api request } { conversation api response } user input app response
  12. 12. “ Intent Matching — Match and categorize user utterances to an intent. Entity Extraction — Identify key words and phrases spoken by the user.@
  13. 13. Ok Google, talk to Personal Chef Sure, here’s Personal Chef What are you in the mood for? What protein would you like to use? Speech to Text NLP Knowledge Graph ML Ranking User Profile Speech to Text Text to Speech ... ... ... Trigger WELCOME event ... NLP: Intent Matching Entity Extraction Well, it’s kind of cold outside, so I’d like...
  14. 14. “Find me a recipe for homemade cannoli” User Says Response “Here’s the best one I can find” Webhook Entities: homemade cannoli “Find me a recipe for homemade cannoli”
  15. 15. A magical experience
  16. 16. g.co/dev/ActionsDesign
  17. 17. Support different surface capabilities https://developers.google.com/actions/assistant/surface-capabilities AUDIO_OUTPUT SCREEN_OUTPUT
  18. 18. function simpleResponse (app) { app.ask({ speech: 'Howdy! I can tell you fun facts about ' + 'almost any number, like 42. What do you have in mind?', displayText: 'Howdy! I can tell you fun facts about ' + 'almost any number. What do you have in mind?' }); } Support speech and display text https://developers.google.com/actions/assistant/responses Chat text should be a subset of audio
  19. 19. function suggestionChips (app) { app.ask(app.buildRichResponse() .addSimpleResponse({ speech: 'Howdy! I can tell you fun facts about ' + 'almost any number like 0, 42, or 100. What number do you have ' + 'in mind?', displayText: 'Howdy! I can tell you fun facts about almost any ' + 'number. What number do you have in mind?' }) .addSuggestions(['0', '42', '100', 'Never mind']) ); } Guide the user (suggestion chips) https://developers.google.com/actions/assistant/responses “OK Google, Talk to Bitcoin Info”
  20. 20. function basicCard (app) { app.ask(app.buildRichResponse() .addSimpleResponse('Math and prime numbers it is!') .addBasicCard( app.buildBasicCard(`42 is an even composite number. It ` + `is composed of three distinct prime numbers multiplied together. It ` + `has a total of eight divisors. 42 is an abunt number, because the ` + `sum of its proper divisors 54 is greater than itself. To count from ` + `1 to 42 would take you about twenty-one…`) .setTitle('Math & prime numbers') .addButton('Read more') .setImage('https://example.google.com/42.png', 'Image alternate text') ) ); } Display basic cards https://developers.google.com/actions/assistant/responses “OK Google, Talk to Marathon List And Tips”
  21. 21. Lists and carousels for selection https://developers.google.com/actions/assistant/responses Used for easy selection <10 items Used for comparison <30 items “OK Google, Talk to Marathon List And Tips”
  22. 22. Google Home Mobile Device NAME Registered device user’s full name Registered device user’s full name DEVICE_COARSE_LOCATION Zip code and city N/A DEVICE_PRECISE_LOCATION Coordinates and street address Coordinates let permission = app.SupportedPermissions.DEVICE_COARSE_LOCATION; app.askForPermission('To find bookstores near you', permission); Q: "Recommend me a local bookstore" A: "To find bookstores near you, I'll just need to get your zip code from Google. Is that okay?" Ask for information https://developers.google.com/actions/assistant/helpers#user_information
  23. 23. Link an account to your OAuth2 server https://developers.google.com/actions/identity/ Seamless account linking with Google Sign-in
  24. 24. Transact with the user https://developers.google.com/actions/identity/ Build orders Use Google provided payment instrument Use your payment processor (Stripe, Braintree, Vantiv, more coming) Update order status
  25. 25. Smart Home developers.google.com/actions/smarthome/ What is the temperature inside? Turn off all the lights. Dim the lights in the living room a little bit. What lights are on in the living room? Make it warmer. How many lights are on?
  26. 26. Google Assistant SDK developers.google.com/assistant/sdk
  27. 27. Reach users
  28. 28. In Dialogue Discovery: Explicit Triggering Ok Google, ask Personal Chef for a hot soup recipe Trigger Phrase App Name Developer Specified Action Preposition Action Phrase Developer Specified Working Examples: Let’s speak to Domino’s Ask Dr. Doggy if dogs can eat chocolate Ok Google, let’s talk to Personal Chef Trigger Phrase App Name Developer Specified
  29. 29. Hey Google, I want to play a game. Hey Google, tell me a joke. In Dialogue Discovery: Implicit Triggering Hey Google, I want to work out. Hey Google, what’s the surf report
  30. 30. Discovery in the Google Assistant Directory
  31. 31. Link to your Assistant App From anywhere Examples: ido-green.appspot.com/bots.html
  32. 32. Where do I start?
  33. 33. developers.google.com/actions
  34. 34. codelabs.developers.google.com
  35. 35. Actions on Google Developer Community https://g.co/actionsdev Actions on Google Developers https://developers.google.com/actions Actions on Google Twitter https://twitter.com/actionsongoogle bit.ly/aog-tips
  36. 36. +GreenIdo @GreenIdo Thank you!
  37. 37. 87% of B2C marketers in the US believe chatbots and digital assistants will play a significant role in marketing before 2021. —eMarketer

×