台灣人工智慧小聚 https://www.facebook.com/groups/datasci.dinner/ 台灣人工智慧小聚 - Taipei#20190823 https://aiacademy.neticrm.tw/civicrm/event/info?reset=1&id=71 【講者2：林建宏 Wolke Lin】 台灣 8 位 LAE (LINE API EXPERT)之一 、亞太 4 位 Assistant GDE(Google Developer Expert) 之一。專長軟體工程、系統開發、技術文件寫作、教育訓練，喜好研究程式語言、框架、社群，從中學習設計，目前以node.js 開發前後台及智能語音應用/聊天機器人為主。 【Google Assistant Overview】 本次講題將介紹 Google Assistant 目前的狀況、未來展望、及目前全球和台灣的相關應用。Google在2016年發布了Google Asisitant服務，至今有3年的時間，從一開始支援14國8種語言，到現在80國30種語言；從必須在雲端執行的100GB資料量，縮小到可放在手機執行的0.5GB資料量。從手機、電腦、Smart Home各種面向，Google Asisitant將怎麼影響我們未來的生活?身為一個開發者，又有哪些機會?讓我們一同來探討!

2. Agenda
● me
● intro Assistant at google IO 2019
● AoG起⼿手式

3. 林林建宏 Wolke
Software Engineer / IT Architect
Google Developers Expert (Assistant)
LINE Message API Expert

4. Assistant GDE

8. LINE Message API Expert

9. https://www.line-community.me/contributors

11. AoG & LINE Bot Dialogflow⼯工作坊

20. AoG & LINE Bot Dialogflow ⼯工作坊
● 5/30 GDG 台中 monospace
● 6/4 GDG 花蓮 東華⼤大學
● 6/17⾏行行政院台中福爾摩沙雲創基地
● 7/7 GCPUG 台北
GCP serverless solution with
chatbot webhook
● 7/11 GDG 桃園中壢 新明青創基地
● 7/18 下午 GDG 台南 好想⼯工作室
● 7/28 上午 GDG ⾼高雄 DAKUO |
⾼高雄市數位內容創意中⼼心
● 7/28 下午 GCPUG ⾼高雄 DAKUO
| ⾼高雄市數位內容創意中⼼心
GCP serverless solution with
chatbot webhook

21. AoG & LINE Bot Dialogflow ⼯工作坊
● 8/8 台南 胖地 台南數位⽂文創園區
● 8/12 MLDM 台北數位產業園區
● 8/29 下午 台南新營 南⽅方創客中
⼼心
● 9/5 晚上 GDG 新⽵竹
● 9/11 晚上 Chatbot.tw 中部⼈人 台
中夢森林林

22. Google Developer Group

24. intro Assistant at google IO 2019

25. For Assistant users...

26. Current Google Assistant Status

27. 35 months
after the Google Assistant launched on Google I/O 2016

28. 8 → 30 languages
14 → 80 countries
The Assistant went global (up from last year).

29. Improvement of Google Assistant

32. Speech recognition becomes so fast by next generation assistant.

33. Google Assistant shows you a specific result by Personalize help.

34. "Hey Google, let's drive" Driving mode brings a user many things, which the user may do during driving a car.

35. Users can stop the alarm by calling "Stop!" only without "Hey Google".

36. Nest Hub / Nest Hub Max

37. Google focuses on Smart Display.

38. "Google Home Hub" rebrands as "Nest Hub". Nest Hub will sale some countries including Japan!

39. 10 inch display with Camera
Face Match with Camera
Operate by Gesture with Camera
Video Call with Google Duo
$229 this summer on US, UK,
AU
Nest Hub Max

40. For action developers...

41. For action developers
If you are a...
● Content Owner
● Android app developer
● Hardware developer
● Innovator in the
Conversational space
Markup, Template, Mini-apps
App Actions
Smart Home
Conversation Actions,
Interactive Canvas

42. How-to and FAQ content

43. Markup, Template, Mini-apps

44. <script type="application/ld+json">
{
"@context": "http://schema.org",
"@type": "HowTo",
"name": "How to Install a Dog Door",
"description": "...easy instructions on how to install a dog door...",
"step": [
{
"@type": "HowToStep",
"name": "Remove Screen Door",
"image": "https://diy.snding.com/content/...",
"text": "Remove the screen door from the door frame...",
"url": "https://www.diynetwork.com/.../install-a-dog-door#step1"
}, ...
]
}
</script>
When writing a metadata with "HowTo" type defined by schema.org,

45. the instruction will not only be shown on the search result with rich UI experience,

46. but it also will be shown on Smart Display as well. If clicking the "Start tutorial" button,

47. App Actions

48. App Actions let users launch specific features in your app using the Google Assistant.

49. Google Assistant sends an intent to the registered Android app.

51. Smart Home

53. Each element which consists of Smart Home is managed by Home Graph.

54. Traits are each behavior of devices. These new traits have been defined.

55. We have a integration way with Cloud-to-Cloud path. Now, we will a new way with Local Home SDK as well.

56. Interactive Canvas

57. Canvas is a framework that allows developers to add a visual, immersive experience to conversational Actions.

58. Interactive Canvas can be built with Web Standard Technologies.

59. Conversation Actions

60. Interactive Canvas can be built with Web Standard Technologies.

61. Conversation Actions
▪ 須經由問答、來來回溝通才能完成。
▪ 問題或需求重複性⾼高。
▪ 回答或處理理流程固定。
▪ 客服⼈人員：使⽤用者問題⼤大致雷同，解決⽅方式也都相對固定。
▪ 問卷：問題和回答選項都固定。
▪ ⾯面試：⾯面試者想問公司的問題

62. Sessions

63. Design and Build Actions
For designing and building your actions:
● Prototyping Voice Experiences: Design Sprints for the Google Assistant
● Intro to the Google Assistant: Build Your First Action
● 10 Best Practices for High Quality Actions
● Let’s Talk: Designing Quality Conversations for the Google Assistant

64. Smart Home
For building Smart Home actions:
● Smart Home 101: How to Develop for the Connected Home
● Local Technologies for the Smart Home
● Tools for Building Better Smart Home Actions

65. Search and Assistant
For providing your contents :
● Create App-like Experiences on Google Search and the Google Assistant
● Enhance Your Search and Assistant Presence with Structured Data

66. Android
For integrating with Android:
● Extend Your Android App to the Google Assistant

67. Smart Display
For adjusting your actions for Smart Display:
● What’s New in the Google Cast SDK
● Build Interactive Games for the Google Assistant
● Voice and Visual: How to Build Actions for Smart Displays and More Devices

68. Others
● Reach the Next Billion Users with Your Actions for the Google Assistant
● How We Built the Google Assistant Sandbox Demos (And How You Can Too)
● Data and Insights to Build for the Digital Assistant Era

69. 應⽤用

70. Speech recognition becomes so fast by next generation assistant.

71. https://assistant.google.com/explore?hl=en

72. https://assistant.google.com/explore?hl=zh_tw

74. Start your first action

75. #AoGDevs
Hey Google, how can I build on
Google Assistant?

76. #AoGDevs
Google Assistant

77. #AoGDevs
Ready to

78. #AoGDevs
JapaneseGerman
FR French
CA French
KoreanUK English
AU English
CA English
US English
Italian
Spanish BR Portuguese
LATAM Spanish
Hindi & IN English
A growing audience:
Swedish
Danish
Norwegian Indonesian
Russian
Thai
Dutch

79. #AoGDevs
Devices with the Google
Assistant built-in
These include voice
activated speakers like
Google Home, Android
phones, iPhones etc.
The Google Assistant
A personal virtual
assistant that enables
conversation between
you and Google to get
things done.
Actions on
Google
Actions on Google is
a developer platform
that lets you create
user experiences for
the Google
Assistant.

80. #AoGDevs

81. #AoGDevs

82. Ok Google, talk
to Women in
Tech
Sure, here’s
Women In Tech
Welcome … To start, you can learn
more about a specific person, like
Edith Clarke or Dorothy Vaughan,
or I can give you a fun fact. Which
would you like?
Deborah
Berebichez….
Speech to Text
NLP
Knowledge
Graph
ML Ranking
User Profile
Speech to Text
Text to Speech
Invoke Women in
Tech
Parse query and
generate
response
Random fact
Text to Speech

83. #AoGDevs
But...
Ummm… I already know about
Grace Hopper and Ada Lovelace, so
let’s do a random fun fact.

84. #AoGDevs
“
Intent Matching — Match and categorize user
utterances to an intent.
Entity Extraction — Identify key words and
phrases spoken by the user.@

85. #AoGDevs
Speech to Text
NLP
Knowledge
Graph
ML Ranking
User Profile
Speech to Text
Text to Speech
..
.
..
.
Trigger
WELCOME event
..
.
NLP:
Intent Matching
Entity Extraction
Text to Speech
Ok Google, talk
to Women in
Tech
Sure, here’s
Women In Tech
Welcome … To start, you can learn
more about a specific person, like
Edith Clarke or Dorothy Vaughan,
or I can give you a fun fact. Which
would you like?
Deborah
Berebichez….
Random fact

86. #AoGDevs
Let’s Build

87. #AoGDevs
What we’ll build today!
It’s green!
Welcome! What is your
favorite color?
Your lucky number is 5

88. #AoGDevs
To Start Codelab Level 1
bit.ly/io19codelab

90. #AoGDevs
Next Steps
" Codelab 2 & 3
" Join our communities
Actions on Google Developer Community
https://www.reddit.com/r/GoogleAssistantDev
Actions on Google Twitter
https://twitter.com/actionsongoogle
#AoGDevs

91. #AoGDevs
Console
console.actions.google.com
Build with Templates
developers.google.com/actions/templates
Build with Dialogflow
developers.google.com/actions/dialogflow
Build with Actions SDK
developers.google.com/actions/sdk
Build with Sample Actions
developers.google.com/actions/samples/actions
Resources to get started and supported
Documentation
developers.google.com/actions
Codelabs
codelabs.developers.google.com
Write and Deploy Functions
bit.ly/firebase-get-started
Sample Code on Github
https://github.com/actions-on-google
Deploy your fulfillment webhook using
Cloud Functions for Firebase
bit.ly/aog-cloud-functions

92. #AoGDevs
Actions on Google Community Program
developers.google.com/actions/community
You are automatically invited to the program with publishing your first Action and
will receive a
Cool T Shirt + $200 Cloud Credits per month for a year
The Assistant team also recognizes milestones:
Traction Engagements Globalization

93. 林林建宏
LAE & GDE
medium.com/@wolkesau
Thank you
● 8/29 下午 台南新營 南⽅方創客中
⼼心
● 9/5 晚上 GDG 新⽵竹
● 9/11 晚上 Chatbot.tw 中部⼈人 台
中夢森林林