Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

AI Dev Days - Applying Alexas Natural Language to Your Challenges - Sohan

4,165 views

Published on

This talk was presented by Sohan Maheshwar (Amazon) as part of the AI Dev Days conference held on 9th March 2018 in Bangalore. URL: www.aidevdays.com
--
This talk will give you a complete picture of all the tools and techniques required to build complex production-quality Alexa skills. You will leave this session knowing how to use Alexa’s dialog management entity resolution and slot elicitation capabilities as well as how to process the results through a Microservice with AWS Lambda. The talk will also touch upon some of the key design principles while designing for voice.

Published in: Software
  • Be the first to like this

AI Dev Days - Applying Alexas Natural Language to Your Challenges - Sohan

  1. 1. Apply Alexa’s Natural Language To Your Challenges @AlexaDevs Sohan Maheshwar, Alexa Evangelist
  2. 2. 70s 80s 90s 00s Present Graphical User Interface (GUI) Character Mode Voice User Interface (VUI) Mobile Web
  3. 3. VOICE REPRESENTS THE NEXT MAJOR DISRUPTION IN COMPUTING
  4. 4. and growing every day
  5. 5. Building for Voice with Alexa
  6. 6. Alexa Skills Kit Request Audio Response Your Service Text to Speech Machine Learning Natural Language Understanding Speech Recognition Cards
  7. 7. Wake Word Alexa, wake word
  8. 8. Wake and Launch Start Launch Begin Resume Ask Tell Alexa, open Bangalore Guide wake word Invocation namelaunch
  9. 9. Utterances and Intents Alexa, open Bangalore Guide and recommend an attraction wake word utteranceInvocation namelaunch
  10. 10. Utterances and Intent Recommend an Attraction utterance AttractionIntent Intent Alexa, open Bangalore Guide
  11. 11. Utterances and Intents
  12. 12. Intent and Slot Recommend an Attraction within four miles AttractionIntent slot {distance: “4”} slot value Alexa, open Bangalore Guide utterance Intent
  13. 13. Conversation
  14. 14. One-shot invocation
  15. 15. One-shot invocation
  16. 16. Multi-turn Dialogs Alexa, start outdoor guru Welcome to… Alexa, ask outdoor guru about hiking Where to? Goa Goa? Yes When .. leave? Next Friday Until when? The following Tuesday What will you like to do? I’ll be fishing Did I get all this right? yes I have two ideas for you… Invoking the skill Dialog support Intent handling
  17. 17. Multi-turn Dialogs Alexa, start outdoor guru Welcome to… Alexa, ask outdoor guru about hiking Where to? Goa Goa? Yes When .. leave? Next Friday Until when? The following Tuesday What will you like to do? I’ll be fishing Did I get all this right? yes I have two ideas for you… Slot elicitation Slot confirmation Intent confirmation
  18. 18. GRAPH UI VS. FRAME UI
  19. 19. Slots {animal} dog cat {size} tiny small medium large {fur} long short {temperament} playful lazy mean I’d like a that’s haired, and {animal} dog cat {size} tiny small large gigantic {fur} long short {temperament} playful lazy mean I’d like a with hair.
  20. 20. Dialog Management {size} {fur} {temperament} petMatchAPI () prompt prompt prompt dialog complete dialog in progress dialog directive: delegate or elicit slot with prompt
  21. 21. small mini ? little ? petite ? {size} tiny small medium large
  22. 22. Entity Resolution {size} synonyms tiny mini, petite, teacup small mini, little, lap, tiny medium average, typical large Huge, big, gigantic
  23. 23. Entity Resolution - Match "slots": { ”size": { "value": "little", "resolutions": { "resolutionsPerAuthority": [ { "status": { "code": "ER_SUCCESS_MATCH”}, "values": [{ "value": { "name": "small" } {size} tiny small medium large
  24. 24. Entity Resolution – Match Multiple Values "slots": { ”size": { "value": "mini", "resolutions": { "resolutionsPerAuthority": [ { "status": { "code": "ER_SUCCESS_MATCH"}, "values": [{ "value": { "name": "tiny” }, "value": { "name": "small” }, {size} tiny small medium large
  25. 25. Entity Resolution – No Match "slots": { ”size": { "value": "itty bitty", "resolutions": { "resolutionsPerAuthority": [ { "status": { "code": "ER_SUCCESS_NO_MATCH"} {size} tiny small medium large
  26. 26. What’s Your Core Functionality? Traffic Skill Example Give an estimated time of arrival from home to work Crawl
  27. 27. Analyze user feedback & optimize skill What’s Your Core Functionality? Traffic Skill Example Give an estimated time of arrival from home to work Crawl Expand Capabilities & Features Traffic Skill Example Include accidents, construction and closures on route Walk
  28. 28. Analyze user feedback & optimize skill Innovate for Customers What’s Your Core Functionality? Traffic Skill Example Give an estimated time of arrival from home to work Crawl Expand Capabilities & Features Traffic Skill Example Include accidents, construction and closures on route Walk Evolve over Time Traffic Skill Example Proactively alert user to delays and provide alternate routes Run
  29. 29. BUILDING NATURAL LANGUAGE DIALOGS Dialog Management and Entity Resolution alexa.design/guide alexa.design/India
  30. 30. Thank you! @soganmageshwar | sohanm@amazon.com Sohan Maheshwar, Alexa Evangelist

×