The document describes an inventory assistant named Jessie that is built using NodeJS, Express, MongoDB, and API.AI to allow a user to interact with Google Assistant or Alexa to add or remove items from an inventory list and receive the current inventory details. Key aspects covered include how the bot maps user intents to actions, stores and retrieves data from a MongoDB collection, and is deployed to Heroku for hosting with the fulfillment handled through webhooks to the backend server.

1. Meet Jessie
‘Inventory assistant’
google actions
Stephen Samuel

2. Why Jessie?

4. Sam
Bob

7. NodeJS
webhook
MongoDB
collection (mLab)
api.ai
intent vs action
Heroku
host server
Remove items
from the
collection
Send the list to
Keep/ Express
Assist first time
user
Adding item to
the collection

8. Google home
voice activated speaker
Google assistant
A conversation between you and Google that
helps you get more done in your world.
Actions on Google
How developers can
extend the assistant

9. “Jessie, what do I have in my inventory?”
There are no items added to our inventory,
can we add now?
Intent of user
Action to be performed

10. “Sure, I have sugar 5kg”
added sugar 5kg to the inventory
Intent of user
Action to be performed

11. “Jessie,
Should I shop today, how is my inventory looking?”
you have the necessary items at home for
this week.
Intent of user
Action to be performed

12. High level

13. • Demo

14. Uncle Bob
Conversation action
Map user’s intent with an action and
routes to the fulfillment backend
service
Receives the action and parameters
from api.ai. Process request and
generate the dialog output
stores/ retrieves
from the mongoDB
collection
fulfillment/ web hook
What is happening here?

17. Send the list to
Keep/ Express
Train the Bot
ML
talk to
RaspberryPi
Alexa
Compatible
Automate
home
Next on our list!
firebase
backend

18. Learnings
• Technology:
• NodeJS/ Express framework, mongoDB, REST api/ Web hook
• api.ai / SSML/ Heroku deploy
• Keep it simple: One chat one list.
• Create less commands
• as you can./add and /remove are the only actions that let you manipulate the list
• Let the bot learn itself

19. Hey Google, Why don't you ask it yourself?
Alexa, ask pi to check the temperature
outside. I’m feeling hot in here!
Make them talk together!

20. Oh Good! Seriously!!
Will not talk to pi until he apologies for what
happened yesterday!
Make them talk together!
10011101001