SlideShare a Scribd company logo
1 of 21
Internet of Things and Google
Assistant
Le Cong Vinh Khai
TAPIT Co., Ltd Director
IoT R&D Leader
1
SMARTHOME ACTIONS
CONTENT
 About us
 Internet of Things and VUIs
 Why Google Assistant?
 Actions on Google: Smart home Actions
 Steps
2
3
About us
Name: Lê Công Vĩnh Khải
Date of Birth: December 4, 1995
Work: IoTs R&D Leader at TAPIT Co., Ltd
Email: vinhkhai95@gmail.com
Phone: +84787412885
Experience: More than 2 years experience in IoTs
research.
4
CÔNG TY TNHH KỸ THUẬT TAPIT
MST: 0401918051
SĐT: 0981001119
Website: https://tapit.vn
Địa chỉ: 146 Trương Định, TP.Đà Nẵng
About us
Internet of Things
Mr. Lê Công Vĩnh Khải
Mr. Ngô Văn Trung
Embedded System
Ms. Trần Thụy Ngọc Hằng
Mr. Đậu Đức Thắng
Mr. Huỳnh Ngọc Thương
Hardware Design
Mr. Ngô Thanh Liêm
Mr. Nguyễn Huỳnh Nhật Thương
CỘNG ĐỒNG KỸ THUẬT TAPIT
300+ thành viên
+ 6 trường đại học từ TP. Đà Nẵng, TP. Hà Nội, TP. Hồ Chí Minh
+ 24% kỹ sư, 19% sinh viên năm 5, 27% sinh viên năm 4, 23% sinh viên năm 3,...
+ 10 chuyên ngành, lĩnh vực khác nhau
Training
-Vi điều khiển: STM32,
MSP430, Arduino.
- Internet of Things.
- C/C++
fb.com/tapit.vn0981001119 https://tapit.vntapitlrs@gmail.com
Internet of Things and VUIs
5
VUIs: Voice User Interfaces The Next Disruption
Alexa
Google Assistant
Siri
Cortana Bixby
6
7
Why is Google Assistant?
Asia Pacific
8
9
Compatibility
Sonoff Philips Hue
Belkin WeMo Lutron
10
Broadlink
Xiaomi
Actions
on
Google
Smart Home Actions
Conversation Actions
11
Actions on Google
 Smart Home Actions: Control IoT devices (connect, query and
control through existing cloud infrastructure).
 Conversation Actions: Invoke Actions to build two-way interactive
conversations between users and assistant (News, Shopping, Quiz
Game, IoTs…)
Smart home
Actions
Sonoff
Philips Hue
Belkin WeMo
Lutron
12
Broadlink
Xiaomi
13
Smart homeActions
Google Home App Manufacturer/Personal Cloud
auth/token server
smarthome server
2. SYNC intent
3.EXEC/QUERY intent
Request
Response
Response
Request
1. Account linking
OAuth Credentials
 SYNC: Requests the list of devices that the user has connected and are
available for use.
 EXEC: Requests a command to execute on smart home devices
“Ok Google, change the TAPIT light to blue !”
 QUERY: Queries for the current states of devices
“Hey Google, is the TAPIT fan on?”
Flow for device setup
14
Google Assistant
15
Flow for execution/query
Device Cloud Service
HomeGraph
EXEC intent
QUERY intent
Response
User say
16
Device definition
DEVICE DEVICE TYPE DEVICE TRAITS
Light action.devices.types.LIGHT action.devices.traits.Brightness
action.devices.traits.ColorSetting
action.devices.traits.OnOff
Fan action.devices.types.FAN action.devices.traits.OnOff
action.devices.traits.FanSpeed
action.devices.traits.Modes
action.devices.traits.Toggles
Washer action.devices.types.WASHER action.devices.traits.OnOff
action.devices.traits.StartStop
action.devices.traits.Modes
action.devices.traits.Toggles
action.devices.traits.RunCycle
………. …………… ……………..
Supported more than 20 different device types
17
SYNC intent for LIGHT
{
"requestId": "ff36a3cc-…",
"inputs": [{
"intent":"action.devices.SYNC"
}]
}
{
"requestId": "ff36a3cc….",
"payload": {
"agentUserId": "1836",
"devices": [
{
"id": "123",
"type": "action.devices.types.LIGHT",
traits: [
“action.devices.traits.OnOff”,
“action.devices.traits.Brightness”,
“action.devices.traits.ColorSetting”
],
“name”: {
name: ‘tapit light',
},
……………….
}
Request Response
18
EXEC intent for LIGHT
{
"requestId": "ff36a3cc-….",
"inputs": [{
"intent": "action.devices.EXECUTE",
"payload": {
"commands": [{
"devices": [{
"id": "123"
}],
"execution": [{
"command": "action.devices.commands.OnOff",
"params": {
"on": true
}
}]
}
{
"requestId": "ff36a3cc-…",
"payload": {
"commands": [
{
"ids": [
"123"
],
"status": "SUCCESS",
"states": {
"on": true,
"online": true
}
}
]
}
}
Request Response
19
QUERY intent for LIGHT
{
"requestId": "ff36a3cc…",
"inputs": [{
"intent": “action.devices.QUERY”,
"payload": {
"devices": [{
"id": "123",
}]
}
}]
}
{
"requestId": "ff36a3cc-…",
"payload": {
"devices": {
"123": {
"on": true,
"online": true
}
}
}
}
Request Response
2020
Steps
1. Set up an server for Account Linking (AUTH, TOKEN) and
Smart home intents (SYNC, EXEC, QUERY).
2. Set up database for devices state storage
3. Create an Actions on Google developer project.
4. Provide server URL for requesting.
Using Cloud Functions for Firebase
Using Firebase Realtime Database
21

More Related Content

Similar to [DevDay2019] Developing IoTs application combines Google Assistant with the most natural experience - By Le Cong Vinh Khai, IoTs R&D Leader at TAPIT Co., Ltd

Internet of Things
Internet of ThingsInternet of Things
Internet of Thingstheswap38
 
Creating an Internet of Everything
Creating an Internet of Everything Creating an Internet of Everything
Creating an Internet of Everything AllSeen Alliance
 
Understanding IoT with Cloud IoT Core
Understanding IoT with Cloud IoT CoreUnderstanding IoT with Cloud IoT Core
Understanding IoT with Cloud IoT CoreTegar Imansyah
 
IRJET- Home Control System using Artificial Intelligence
IRJET- Home Control System using Artificial IntelligenceIRJET- Home Control System using Artificial Intelligence
IRJET- Home Control System using Artificial IntelligenceIRJET Journal
 
IoT Based Home Automation System Presantation
IoT Based Home Automation System PresantationIoT Based Home Automation System Presantation
IoT Based Home Automation System PresantationFarhan Ahmed Rahee
 
iot1presentation-191219142803.pdf
iot1presentation-191219142803.pdfiot1presentation-191219142803.pdf
iot1presentation-191219142803.pdfBharathReddy615859
 
How to Start Building Your IoT Application
How to Start Building Your IoT ApplicationHow to Start Building Your IoT Application
How to Start Building Your IoT ApplicationDr. Mazlan Abbas
 
Internet of things (iot).overview
Internet of things (iot).overviewInternet of things (iot).overview
Internet of things (iot).overviewramky1978
 
The Programmable Internet of Things
The Programmable Internet of ThingsThe Programmable Internet of Things
The Programmable Internet of ThingsRich Miller
 
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEM
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEMGOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEM
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEMIRJET Journal
 
IRJET - Google Assistant Controlled Home
IRJET -  	  Google Assistant Controlled HomeIRJET -  	  Google Assistant Controlled Home
IRJET - Google Assistant Controlled HomeIRJET Journal
 
IOT Success depends on Integration
IOT Success depends on Integration IOT Success depends on Integration
IOT Success depends on Integration John Mathon
 
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdf
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdfIIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdf
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdfDr. Mazlan Abbas
 
Smart Home Automation using Voice Assistant
Smart Home Automation using Voice AssistantSmart Home Automation using Voice Assistant
Smart Home Automation using Voice AssistantTezpur University
 
IoT based home automation
IoT based home automationIoT based home automation
IoT based home automationEyaminulHoq
 
Home Automation Control System
Home Automation Control SystemHome Automation Control System
Home Automation Control SystemIRJET Journal
 

Similar to [DevDay2019] Developing IoTs application combines Google Assistant with the most natural experience - By Le Cong Vinh Khai, IoTs R&D Leader at TAPIT Co., Ltd (20)

Internet of Things
Internet of ThingsInternet of Things
Internet of Things
 
Creating an Internet of Everything
Creating an Internet of Everything Creating an Internet of Everything
Creating an Internet of Everything
 
Understanding IoT with Cloud IoT Core
Understanding IoT with Cloud IoT CoreUnderstanding IoT with Cloud IoT Core
Understanding IoT with Cloud IoT Core
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
IRJET- Home Control System using Artificial Intelligence
IRJET- Home Control System using Artificial IntelligenceIRJET- Home Control System using Artificial Intelligence
IRJET- Home Control System using Artificial Intelligence
 
IoT Based Home Automation System Presantation
IoT Based Home Automation System PresantationIoT Based Home Automation System Presantation
IoT Based Home Automation System Presantation
 
iot1presentation-191219142803.pdf
iot1presentation-191219142803.pdfiot1presentation-191219142803.pdf
iot1presentation-191219142803.pdf
 
How to Start Building Your IoT Application
How to Start Building Your IoT ApplicationHow to Start Building Your IoT Application
How to Start Building Your IoT Application
 
Shya_Documentation
Shya_DocumentationShya_Documentation
Shya_Documentation
 
Internet of things (iot).overview
Internet of things (iot).overviewInternet of things (iot).overview
Internet of things (iot).overview
 
The Programmable Internet of Things
The Programmable Internet of ThingsThe Programmable Internet of Things
The Programmable Internet of Things
 
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEM
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEMGOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEM
GOOGLE ASSISTANT SMART HOME USING A MULTI-LINGUAL SPEECH RECOGNITION SYSTEM
 
IRJET - Google Assistant Controlled Home
IRJET -  	  Google Assistant Controlled HomeIRJET -  	  Google Assistant Controlled Home
IRJET - Google Assistant Controlled Home
 
IOT Success depends on Integration
IOT Success depends on Integration IOT Success depends on Integration
IOT Success depends on Integration
 
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdf
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdfIIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdf
IIOT – Opportunities & Challenges (How-To Start Your IoT Project).pdf
 
Smart Home Automation using Voice Assistant
Smart Home Automation using Voice AssistantSmart Home Automation using Voice Assistant
Smart Home Automation using Voice Assistant
 
IoT based home automation
IoT based home automationIoT based home automation
IoT based home automation
 
Home automation using IOT
Home automation using IOTHome automation using IOT
Home automation using IOT
 
Home Automation Control System
Home Automation Control SystemHome Automation Control System
Home Automation Control System
 
IOT ppt.pptx
IOT ppt.pptxIOT ppt.pptx
IOT ppt.pptx
 

More from DevDay.org

[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at WizelineDevDay.org
 
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...DevDay.org
 
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...DevDay.org
 
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at WizelineDevDay.org
 
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...[DevDay2019] Growth Hacking - How to double the benefits of your startup with...
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...DevDay.org
 
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...[DevDay2019] Collaborate or die: The designers’ guide to working with develop...
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...DevDay.org
 
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...DevDay.org
 
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...DevDay.org
 
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...DevDay.org
 
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...DevDay.org
 
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMSDevDay.org
 
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...DevDay.org
 
[Devday2019] Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...
[Devday2019]  Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...[Devday2019]  Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...
[Devday2019] Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...DevDay.org
 
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...DevDay.org
 
[DevDay2019] Opportunities and challenges for human resources during the digi...
[DevDay2019] Opportunities and challenges for human resources during the digi...[DevDay2019] Opportunities and challenges for human resources during the digi...
[DevDay2019] Opportunities and challenges for human resources during the digi...DevDay.org
 
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...DevDay.org
 
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...DevDay.org
 
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...DevDay.org
 
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...DevDay.org
 
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IODevDay.org
 

More from DevDay.org (20)

[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline[DevDay2019] Lean UX - By  Bryant Castro,  Bryant Castro at Wizeline
[DevDay2019] Lean UX - By Bryant Castro, Bryant Castro at Wizeline
 
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
[DevDay2019] Why you'll lose without UX Design - By Szilard Toth, CTO at e·pi...
 
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...
[DevDay2019] Things i wish I knew when I was a 23-year-old Developer - By Chr...
 
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline
[DevDay2019] Designing design teams - Christopher Nguyen, UX Manager at Wizeline
 
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...[DevDay2019] Growth Hacking - How to double the benefits of your startup with...
[DevDay2019] Growth Hacking - How to double the benefits of your startup with...
 
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...[DevDay2019] Collaborate or die: The designers’ guide to working with develop...
[DevDay2019] Collaborate or die: The designers’ guide to working with develop...
 
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...
[DevDay2019] How AI is changing the future of Software Testing? - By Vui Nguy...
 
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...
[DevDay2019] Hands-on Machine Learning on Google Cloud Platform - By Thanh Le...
 
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...
[DevDay2019] Micro Frontends Architecture - By Thang Pham, Senior Software En...
 
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
[DevDay2019] Power of Test Automation and DevOps combination - One click savi...
 
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS
[DevDay2019] How do I test AI models? - By Minh Hoang, Senior QA Engineer at KMS
 
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...
[DevDay2019] How to quickly become a Senior Engineer - By Tran Anh Minh, CEO ...
 
[Devday2019] Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...
[Devday2019]  Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...[Devday2019]  Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...
[Devday2019] Dev start-up - By Le Trung, Founder & CEO at Hifiveplus and Edu...
 
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...
[DevDay2019] Web Development In 2019 - A Practical Guide - By Hoang Nhu Vinh,...
 
[DevDay2019] Opportunities and challenges for human resources during the digi...
[DevDay2019] Opportunities and challenges for human resources during the digi...[DevDay2019] Opportunities and challenges for human resources during the digi...
[DevDay2019] Opportunities and challenges for human resources during the digi...
 
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...
[DevDay2019] Python Machine Learning with Jupyter Notebook - By Nguyen Huu Th...
 
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...
[DevDay2019] Do you dockerize? Are your containers safe? - By Pham Hong Khanh...
 
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...
[DevDay2019] Develop a web application with Kubernetes - By Nguyen Xuan Phong...
 
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...
[DevDay2019] Paradigm shift towards effective Scrum - By Tam Doan, Agile Coac...
 
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO
[DevDay2019] JAM Stack - By Ngo Thi Ni, Web Developer at Agility IO
 

Recently uploaded

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetEnjoy Anytime
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 

Recently uploaded (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 

[DevDay2019] Developing IoTs application combines Google Assistant with the most natural experience - By Le Cong Vinh Khai, IoTs R&D Leader at TAPIT Co., Ltd

  • 1. Internet of Things and Google Assistant Le Cong Vinh Khai TAPIT Co., Ltd Director IoT R&D Leader 1 SMARTHOME ACTIONS
  • 2. CONTENT  About us  Internet of Things and VUIs  Why Google Assistant?  Actions on Google: Smart home Actions  Steps 2
  • 3. 3 About us Name: Lê Công Vĩnh Khải Date of Birth: December 4, 1995 Work: IoTs R&D Leader at TAPIT Co., Ltd Email: vinhkhai95@gmail.com Phone: +84787412885 Experience: More than 2 years experience in IoTs research.
  • 4. 4 CÔNG TY TNHH KỸ THUẬT TAPIT MST: 0401918051 SĐT: 0981001119 Website: https://tapit.vn Địa chỉ: 146 Trương Định, TP.Đà Nẵng About us Internet of Things Mr. Lê Công Vĩnh Khải Mr. Ngô Văn Trung Embedded System Ms. Trần Thụy Ngọc Hằng Mr. Đậu Đức Thắng Mr. Huỳnh Ngọc Thương Hardware Design Mr. Ngô Thanh Liêm Mr. Nguyễn Huỳnh Nhật Thương CỘNG ĐỒNG KỸ THUẬT TAPIT 300+ thành viên + 6 trường đại học từ TP. Đà Nẵng, TP. Hà Nội, TP. Hồ Chí Minh + 24% kỹ sư, 19% sinh viên năm 5, 27% sinh viên năm 4, 23% sinh viên năm 3,... + 10 chuyên ngành, lĩnh vực khác nhau Training -Vi điều khiển: STM32, MSP430, Arduino. - Internet of Things. - C/C++ fb.com/tapit.vn0981001119 https://tapit.vntapitlrs@gmail.com
  • 5. Internet of Things and VUIs 5 VUIs: Voice User Interfaces The Next Disruption
  • 7. 7 Why is Google Assistant? Asia Pacific
  • 8. 8
  • 10. Sonoff Philips Hue Belkin WeMo Lutron 10 Broadlink Xiaomi
  • 11. Actions on Google Smart Home Actions Conversation Actions 11 Actions on Google  Smart Home Actions: Control IoT devices (connect, query and control through existing cloud infrastructure).  Conversation Actions: Invoke Actions to build two-way interactive conversations between users and assistant (News, Shopping, Quiz Game, IoTs…)
  • 12. Smart home Actions Sonoff Philips Hue Belkin WeMo Lutron 12 Broadlink Xiaomi
  • 13. 13 Smart homeActions Google Home App Manufacturer/Personal Cloud auth/token server smarthome server 2. SYNC intent 3.EXEC/QUERY intent Request Response Response Request 1. Account linking OAuth Credentials  SYNC: Requests the list of devices that the user has connected and are available for use.  EXEC: Requests a command to execute on smart home devices “Ok Google, change the TAPIT light to blue !”  QUERY: Queries for the current states of devices “Hey Google, is the TAPIT fan on?”
  • 14. Flow for device setup 14
  • 15. Google Assistant 15 Flow for execution/query Device Cloud Service HomeGraph EXEC intent QUERY intent Response User say
  • 16. 16 Device definition DEVICE DEVICE TYPE DEVICE TRAITS Light action.devices.types.LIGHT action.devices.traits.Brightness action.devices.traits.ColorSetting action.devices.traits.OnOff Fan action.devices.types.FAN action.devices.traits.OnOff action.devices.traits.FanSpeed action.devices.traits.Modes action.devices.traits.Toggles Washer action.devices.types.WASHER action.devices.traits.OnOff action.devices.traits.StartStop action.devices.traits.Modes action.devices.traits.Toggles action.devices.traits.RunCycle ………. …………… …………….. Supported more than 20 different device types
  • 17. 17 SYNC intent for LIGHT { "requestId": "ff36a3cc-…", "inputs": [{ "intent":"action.devices.SYNC" }] } { "requestId": "ff36a3cc….", "payload": { "agentUserId": "1836", "devices": [ { "id": "123", "type": "action.devices.types.LIGHT", traits: [ “action.devices.traits.OnOff”, “action.devices.traits.Brightness”, “action.devices.traits.ColorSetting” ], “name”: { name: ‘tapit light', }, ………………. } Request Response
  • 18. 18 EXEC intent for LIGHT { "requestId": "ff36a3cc-….", "inputs": [{ "intent": "action.devices.EXECUTE", "payload": { "commands": [{ "devices": [{ "id": "123" }], "execution": [{ "command": "action.devices.commands.OnOff", "params": { "on": true } }] } { "requestId": "ff36a3cc-…", "payload": { "commands": [ { "ids": [ "123" ], "status": "SUCCESS", "states": { "on": true, "online": true } } ] } } Request Response
  • 19. 19 QUERY intent for LIGHT { "requestId": "ff36a3cc…", "inputs": [{ "intent": “action.devices.QUERY”, "payload": { "devices": [{ "id": "123", }] } }] } { "requestId": "ff36a3cc-…", "payload": { "devices": { "123": { "on": true, "online": true } } } } Request Response
  • 20. 2020 Steps 1. Set up an server for Account Linking (AUTH, TOKEN) and Smart home intents (SYNC, EXEC, QUERY). 2. Set up database for devices state storage 3. Create an Actions on Google developer project. 4. Provide server URL for requesting. Using Cloud Functions for Firebase Using Firebase Realtime Database
  • 21. 21

Editor's Notes

  1. https://developers.google.com/actions/smarthome/