Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Conversation With Your Application Using DialogFlow and CloudFunctions

503 views

Published on

Delivered at GDG Cloud Melbourne (February) https://www.meetup.com/GDG-Cloud-Melbourne/events/258047647/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Conversation With Your Application Using DialogFlow and CloudFunctions

  1. 1. Conversation With Your Application Using Dialogflow And CloudFunctions Cliffano Subagio (@cliffano) - Shine Solutions
  2. 2. CLIFFANO SUBAGIO Senior Consultant at Shine Solutions Open Source Contributor - Jenkins - OpenAPI Generator - AEM OpenCloud
  3. 3. Why Voice Matters?
  4. 4. Johannes Gutenberg in the 1400s
  5. 5. Michael Knight in the 1980s
  6. 6. Jean-Luc Picard in the 2300s
  7. 7. Me in 2011
  8. 8. Question: Can we do better in 2019?
  9. 9. Dialogflow + CloudFunctions
  10. 10. Dialogflow * Conversation interface * Natural language processor * Speech to text, text to speech * Intents, entities, fulfilment * Multi languages support * Multi services integration
  11. 11. Cloud Functions * You already know what it is * Functions as a service * Event driven * Support node.js, Python, and Go
  12. 12. Architecture Natural language processing Voice (and text) input Command processing and API calls
  13. 13. Convo * node.js library for voice and text app * Specification based * Generates a Dialogflow agent * Generates a CloudFunctions middleware
  14. 14. Greetings And Unknowns
  15. 15. Queries
  16. 16. A) Static Facts
  17. 17. THOMAS, PERCY, JAMES, GORDON, … Static Facts - Thomas Children App
  18. 18. Static Facts - Thomas Children App
  19. 19. B) Freestyle-CloudFunctions
  20. 20. Freestyle-CloudFunctions Facts - Hacker News
  21. 21. Freestyle-CloudFunctions Facts - Hacker News
  22. 22. C) OpenAPI-CloudFunctions
  23. 23. OpenAPI-CloudFunctions Facts - Jenkins
  24. 24. OpenAPI-CloudFunctions - Data Flow 24 “Build job ABC” “Job ABC has been added to the queue” { “queryText”: “Build job ABC”, “parameters”: { “jobName”: “ABC” }, “intent”: { “displayName”: “build-job” } } POST /job/ABC/build 200 OK { “fulfllmentText”: “Job ABC has been added to the queue”, “payload”: { “google”: { “richResponse”: { “items”: [ “simpleResponse”: { “textToSpeech”: “Job ABC has been added to the queue”, “displayText”: “Job ABC has been added to the queue”, }]}}} } { “inputs": [ { "intent": "actions.intent.TEXT", "rawInputs": [ { "inputType": "VOICE", "query": “Build job ABC” } ]}]} "expectedInputs": [ { "inputPrompt": { "richInitialPrompt": { "items": [ { "simpleResponse": { "textToSpeech": “Job ABC has been added to the queue" } }]}}}]}
  25. 25. Anybody speaks German or Japanese?
  26. 26. Answer: Yes. We can do better in 2019!
  27. 27. What’s Next? 1. Identity forwarding 2. HTTP basic auth on middleware 3. More services integration 4. More applications!
  28. 28. Voice matters. Because not everyone can type.
  29. 29. Thank you. Questions?
  30. 30. Links • https://github.com/cliffano/convo • https://github.com/cliffano/convo-generator • https://github.com/cliffano/convo-node • https://github.com/cliffano/convo-thomas • https://github.com/cliffano/convo-hacker-news • https://github.com/cliffano/convo-hacker-news-helper • https://github.com/cliffano/convo-jenkins • https://github.com/cliffano/convo-jenkins-helper Repositories • https://www.npmjs.com/package/generator-convo • https://www.npmjs.com/package/convo-node • https://www.npmjs.com/package/convo-hacker-news-helper • https://www.npmjs.com/package/convo-jenkins-helper Published Libraries

×