Recommended
More Related Content
What's hot
Viewers also liked
Viewers also liked (20)
Similar to Get Started Developing with Alexa and Drupal
Similar to Get Started Developing with Alexa and Drupal (20)
Recently uploaded
Recently uploaded (20)
Get Started Developing with Alexa and Drupal
- 1. Get Started Developing with Alexa and DrupaL Twin Cities Drupal Camp June 23, 2017 Amber Matz & Blake Hall
- 2. About us Amber Matz Production Manager and Trainer Drupalize.Me @amberhimesmatz Blake Hall Senior Developer and Trainer Drupalize.Me @blakehall
- 3. What We’ll CoveR... • Designing a Voice Interface • Concepts & Process • Creating Your first custom alexa skill • 2 ways to integrate Data from a drupal 8 Site • demos!
- 4. • Custom skills • Smart Home Skills API • Flash Briefing Skill API • Video Skills api (new) Types of Skills
- 5. Soon, You will be: Ready to create your own custom alexa skill! • With or without Drupal Integration • Using "AWS Lambda" or A custom Endpoint
- 7. Choosing projects Choose projects where adding voice will: • make it faster • make it easier • make it fun
- 8. What's Faster? Setting timer with touch (Microwave/Phone) Or Saying "Alexa, Set a timer for 3 minutes" from anywhere in the room?
- 9. What's Easier? • Play/stop a song with menus, screens, buttons? • Hands-free, eyes-free voice request
- 10. More "Easy" Examples "Single-Turn Dialogue" is easy: • Asking alexa for the weather • Asking alexa for a joke
- 11. It should be easy • multiple-turn dialogue needs to be easy • Requires more design work • Explore interaction that can flow in various ways
- 12. Designing for fun • Games should be easy to play but still present a challenge • Is there a place to incorporate humor, surprise, or delight? • How do you want users to feel during/after interaction?
- 13. Be choosy • Be choosy about what to expose as voice interaction • Does it make it Faster, easier, or more fun for the user?
- 14. Design for voice • Determine the purpose • Identify User Stories • write out dialogue for the "happy paths" • Diagram the user flow • Create Interaction model
- 15. how not to start • Don't start with your apI • Don't just add voice commands for each API endpoint • Don't expect users to know your apI
- 16. What's the purpose? • Why would people want to use your alexa skill? • What will they get from the skill that they can't get another way?
- 17. User stories • What can a user do, or not do, with your skill? • What Info Does a person Need to use your skill? • What features directly support the purpose? • Is there Info They'll need from a website or app?
- 18. Dialogue Script • Write the Script between alexa and the user • Focus on the "happy Path" • Does the dialogue flow naturally?
- 19. Tips for Scripts • Keep interactions brief • Write for How people talk, not read or write • Indicate when the user needs to provide info
- 20. Diagram the flow • reference the happy path Script • map out all the inputs needed from the user • branch out to cover additional logic or error cases
- 21. User: “Alexa, Ask fish jokes for a silly joke” Alexa: "Why are salmon so good at using git? They Love to merge upstream.
- 22. Flow Diagram Alexa, ask Fish Jokes for a [silly] joke. Return a joke tagged with term “silly” from fishjokes4.life (Drupal site)
- 23. Interaction model • Implement the entire flow • what are the concrete things that can happen? => Intents • What is said to make these things happen? => Utterances
- 24. Recap: Design for voice • Be Choosy about the project • Determine the purpose • Identify user stories • Write a Script • Diagram the flow • Create the interaction model
- 27. key concepts
- 29. Alexa ask fish jokes for a silly joke
- 30. Alexa ask fish jokes for a silly joke Activation
- 31. Activation • Alexa, Echo, amazon, or Computer • Fixed by Amazon • Can’t be customized • configurable by device
- 32. Alexa ask fish jokes for a silly joke ActivationInvocation
- 33. Invocation • “open”, “launch”, “ask” + your skill name • how your skill is opened
- 34. Alexa ask fish jokes for a silly joke Activation Invocation Utterance&Intent
- 35. Utterances • The phrases your skill will recognize • think about the variables you need (slots)
- 36. Intents • map utterances to functionality • some are built in (help, stop, cancel)
- 37. Alexa ask fish jokes for a silly joke Activation Invocation Utterance&Intent
- 38. Custom skills
- 40. Lambda Blueprints Skill Alexa AWS Lambda Response • Java • Python • Node.js Find on Alexa GitHub AWS Lambda Blueprints
- 41. Lambda data sources Alexa Response or AWS Lambda Skill Results from a Web Services API Call Hard- coded values in an array
- 43. Web services API call Skill Alexa AWS Lambda Response Results from a Web Services API Call JSON
- 45. Creating a custom alexa skill
- 46. Get ready to rock Create an Amazon Developer Account Sign in to developer.amazon.com/ alexa Get started > Alexa Skills Kit
- 52. Add a new skill
- 53. configuration • created in developer portal • so that: alexa can route requests to the service for your skill • brings all skill components together
- 54. Invocation Name • Identifies the skill • user includes this name when initiating a conversation with your skill • must be unique
- 57. Interaction model • Intents • slots • Sample utterances
- 58. Intents Represent: • actions users can do with your skill • core functionality
- 59. Sample Utterances • words/phrases users say to invoke intents • you map utterances to intents • this map forms the interaction model
- 60. slots • Optional Arguments • Need a Type • Need Values • Custom or Built-in
- 61. Beta Interaction Model • Interactive • Walks You Through the process • generates json for you
- 62. Beta Dashboard
- 63. Beta: Add Intent
- 64. Beta: Utterances
- 65. Beta: Utterances
- 66. Sample Utterances Guidelines: • Do not include “Alexa”, “Amazon”, “Echo”, etc. • DO not include the name of your skill
- 67. Sample Utterances Guidelines: • Do include A variety of phrases • DO include “slot names” in curly brackets
- 68. Beta: Slots
- 69. Beta: Slots
- 70. Beta: Slots
- 72. Intent Schema • A JSON structure that declares the set of intents your skill can accept and process
- 73. Intent Schema TIP: • Include Built-In Amazon intents for common actions: “stop”, “Help”, “CANCEL”, ETC.
- 74. Intent Schema { "intents": [ { "intent": "GetNewFactIntent" }, { "intent": "AMAZON.HelpIntent" }, { "intent": "AMAZON.StopIntent" }, { "intent": "AMAZON.CancelIntent" } ] } } Custom intent Amazon built-in intents
- 75. Intent Schema { "intents": [ { "intent": "GetCategorizedJokes", "slots": [ { "name": "Category", "type": "LIST_OF_CATEGORIES" } ] }, { "intent": "GetFishJokes", }, { "intent": "AMAZON.HelpIntent" }, { "intent": "AMAZON.StopIntent" }, { "intent": "AMAZON.CancelIntent" } ] } Custom intent Custom intent } Amazon built-in intents Custom slot type
- 76. Endpoint
- 79. getting started • copy/paste blueprint code examples • refer to docs and resources • Check out Alexa Github
- 80. Write the code Using AWS LAMBDA? • Node.jS • Java • Python
- 81. simple example
- 83. Intent schema
- 84. utterances
- 85. Array of Jokes
- 86. Random Joke
- 87. web service
- 88. Web services API call Skill Alexa AWS Lambda Response Results from a Web Services API Call Views JSON
- 89. Intent schema
- 90. utterances
- 91. API Endpoint Parse the response
- 95. there’s a module for that!
- 97. Alexa module config • give drupal your alexa application id • give alexa the resource callback • write some code
- 98. Event Subscriber
- 99. Slot Random Joke
- 100. Response
- 101. “Alexa Ask fish jokes for a silly joke”
- 104. SSML
- 105. SSML • Whispers • word substitution • emphasis • prosody • Expletive beeps
- 106. SSML Examples • <amazon:effect name="whispered">Hi</ amazon:effect> • <emphasis level=“strong">billy bass</emphasis> • <say-as interpret-as=“digits">12345</ say-as>
- 107. already supported by the alexa library
- 110. Test your skill • Test with service simulator (in developer portal) • Test on Alexa-Enabled device
- 111. certification • Write description • Create + Upload Icon • Submission Checklist • Check email for feedback
- 112. Continue development After skill “Goes Live”: • Dev version auto-created in Developer portal • Work on dev, submit when ready • Certified dev version replaces live version
- 113. Continue development
- 114. demo time
- 115. demo: Fish Jokes
- 118. Demo: Fish jokes with category slot
- 121. Demo: Flash briefing
- 123. ECHO DOT + ARDUINO + Big Mouth Billy Bass 12v power Headphone Audio out 2 or 3 motors connected. 1 in use.
- 124. Tutorial • Instructables.com • “Animate a Billy Bass Mouth With Any Audio Source” • by Donald Bell http://www.instructables.com/id/Animate-a-Billy-Bass-Mouth-With-Any-Audio-Source/
- 125. Recap • Voice Design Process • Interaction Model • 3 ways to create a custom skill, with + without Drupal integration
- 126. q&A?