How to build virtual assistant like Jarvis (in Ironman) with Google Assistant SDK - Thanh Liem

1. How to build virtual
assistant with Google
Assistant SDK
Like Jarvis in Ironman
Nguyen Thanh Liem - Co - Founder of GDGMienTrung

2. Agenda 1. What is virtual assistant & how
could it work ?
2. What does the Google Assistant
SDK can do?
3. Embed the Google Assistant in
Raspberry Pi 3.
4. Create a simple Google Assistant
application.
5. How to make your Virtual
Assistant control things.

3. 1. What is virtual assistant & how could it work ?
Virtual assistant (AI)
A virtual assistant is a software agent that can
perform tasks or services for an individual. Sometimes
the term "chatbot" is used to refer to virtual assistants
generally.
Siri
Google Now
AWS Alexa
Cortana
Jarvis

4. 1. What is virtual assistant & how could it work ?
How could it work ?
Voice Interface Speech to text Natural language
processing
Business logic scenario
processor
Hardware Module

5. 2. What does the Google Assistant SDK can do?
https://developers.google.com/assistant/sdk/
Embed Google Assistant to any devices to use power of GA any
where.
Create your our custom application to be a part of GA services.
Voice interface.
Speech to text.
NLP with api.ai or google NLP tools

6. 3. Embed the Google Assistant in Raspberry Pi 3.
https://developers.google.com/assistant/sdk/prototype/getting-started-pi-python/
Hardware required:
Raspberry Pi 3 Model B and power supply
USB microphone ( USB sound card and mic 3.5mm jack)
Speaker (see recommended USB or 3.5mm-jack)
An SD card with NOOBS pre-installed. NOOBS is an OS installer that
contains Raspbian by default and simplifies OS setup.

7. 3. Embed the Google Assistant in Raspberry Pi 3.
https://developers.google.com/assistant/sdk/prototype/getting-started-pi-python/config-dev-
project-and-account
Create and configure Google cloud project:
Create Google cloud project.
Enable Google Assistant API.
Generate OAuth Client ID

8. 3. Embed the Google Assistant in Raspberry Pi 3.
https://developers.google.com/assistant/sdk/prototype/getting-started-pi-python/run-sample
Install Python ENV and Google Assistant Python library
Install python virtual environment
Install google-assistant-library
Run google-assistant-demo

9. 3. Embed the Google Assistant in Raspberry Pi 3.
https://developers.google.com/assistant/sdk/prototype/getting-started-pi-python/run-sample
DEMO

10. 4. Create a simple Google Assistant application.
Understand how a Google Assistant App work
Working with API.AI
Build service as brain for your assistant.
Test your app on GA simulator.

11. 5. How to make your Virtual Assistant control
things.
RPi.gpio - a library help us to control pins on
raspberry
Google cloud pub/sub - send message to any
client.
Device GA API.AI Server Device

12. Demo
Let virtual assistant help you control your house

13. QA
Thanks for
your
listening.