Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Alexa Skill Maintenance

563 views

Published on

A short presentation about Alexa Skill maintenance from the Alexa Dev Day in Berlin on 26th of November 2019. Discusses metrics, intent history, reviews and new features.

Published in: Technology
  • Login to see the comments

Alexa Skill Maintenance

  1. 1. 1 / 40 Alexa SkillAlexa Skill MaintenanceMaintenance
  2. 2. 2 / 40 Ralf Eggert CEO of Travello GmbH Alexa Partner Agency AWS Certified Alexa Skill Builder Alexa Champion
  3. 3. 3 / 40 Seven Project Phases
  4. 4. 4 / 40 The theory 1. Kickoff 3. Conception 5. Implementation 7. Maintenance 2. Prototyping 4. Design 6. Testing
  5. 5. 5 / 40 The reality 1. Kickoff 3. Conception 5. Implementation 7. Maintenance 2. Prototyping 4. Design 6. Testing
  6. 6. 6 / 40 Continuous Maintenance 1 3 52 4 6 1 3 52 4 6 1 3 52 4 6 7
  7. 7. 7 / 40 How to handleHow to handle Continuous Maintenance?
  8. 8. 8 / 40 MetricsMetrics
  9. 9. 9 / 40 Which metricsWhich metrics are useful?
  10. 10. 10 / 40 Summary Daily or once a week Default is last 7 days Watch the rise or fall 1
  11. 11. 11 / 40 Customers Identify days of highest (SA) and lowest (MO) usage Implement features on days with lowest usage 2
  12. 12. 12 / 40 Sessions Spot error situations Check logs for these situations Try to avoid these situations in future 3
  13. 13. 13 / 40 Intents Spot most used and lesser used intents Improve most used intents Remove lesser used intents (if possible) 4
  14. 14. 14 / 40 Interaction Path Examine carefully! Is your dialog working out? Are people losing their way? 5
  15. 15. 15 / 40 Retention How many come back after one week? After ten weeks? Can you spot any progress? 6
  16. 16. 16 / 40 Intent HistoryHistory
  17. 17. 17 / 40 How toHow to start?
  18. 18. 18 / 40 No data? Nothing to do here Move to next skill 1
  19. 19. 19 / 40 Unresolved Utterances from the last 30 days Examine regularly 2
  20. 20. 20 / 40 Low confidence Start with utterances with low confidence Solve them on daily basis 3
  21. 21. 21 / 40 Medium confidence Continue with utterances with medium confidence Be careful: they are trickier Solve them on weekly basis 4
  22. 22. 22 / 40 Resolve utterances Your interaction model will be changed Don't forget to certify Don't forget to update your backend if any 5
  23. 23. 23 / 40 Bulk mapping Map utterances in a bulk Again: your interaction model will be changed 6
  24. 24. 24 / 40 ReviewsReviews
  25. 25. 25 / 40 Don't be afraidDon't be afraid of bad reviews!of bad reviews!
  26. 26. 26 / 40 Positive reviews Very nice! Hard to use for improvements. 1
  27. 27. 27 / 40 Pure star reviews Nice but almost useless. 2
  28. 28. 28 / 40 Pure negative reviews Sad and almost useless. 3
  29. 29. 29 / 40 Constructive bad reviews Very nice! Very useful for improvements! Don't forget to write back! 4
  30. 30. 30 / 40 New Alexa featuresfeatures
  31. 31. 31 / 40 How to stayHow to stay up to date?up to date?
  32. 32. 32 / 40 Developer blog Try new Alexa features New Alexa features can solve old problems 1
  33. 33. 33 / 40 Newsletter Get the developer newsletter! Both in German and Englisch! 2
  34. 34. 34 / 40 Conclusion
  35. 35. 35 / 40 Project phases Maintenance is the longest project phase!
  36. 36. 36 / 40 Metrics Examine them regularly and act!
  37. 37. 37 / 40 Intent History Improve your interaction model on regular basis!
  38. 38. 38 / 40 Reviews Use the power of constructive bad reviews!
  39. 39. 39 / 40 New Alexa features Stay up to date
  40. 40. 40 / 40 Thanks! ralf@travello.audio https://www.travello.audio

×