Alexa Skill Maintenance

Ralf Eggert
Ralf EggertGeschäftsführer / Gründer at Travello GmbH
1 / 40
Alexa SkillAlexa Skill
MaintenanceMaintenance
2 / 40
Ralf Eggert
CEO of Travello GmbH
Alexa Partner Agency
AWS Certified Alexa Skill Builder
Alexa Champion
3 / 40
Seven
Project
Phases
4 / 40
The theory
1. Kickoff
3. Conception
5. Implementation
7. Maintenance
2. Prototyping
4. Design 6. Testing
5 / 40
The reality
1. Kickoff
3. Conception
5. Implementation
7. Maintenance
2. Prototyping
4. Design
6. Testing
6 / 40
Continuous Maintenance
1 3 52 4 6 1 3 52 4 6 1 3 52 4 6
7
7 / 40
How to handleHow to handle
Continuous
Maintenance?
8 / 40
MetricsMetrics
9 / 40
Which metricsWhich metrics
are useful?
10 / 40
Summary
Daily or once a week
Default is last 7 days
Watch the rise or fall
1
11 / 40
Customers
Identify days of
highest (SA) and
lowest (MO) usage
Implement features on
days with lowest usage
2
12 / 40
Sessions
Spot error situations
Check logs for these
situations
Try to avoid these
situations in future
3
13 / 40
Intents
Spot most used and
lesser used intents
Improve most used intents
Remove lesser used intents
(if possible)
4
14 / 40
Interaction Path
Examine carefully!
Is your dialog working out?
Are people losing their way?
5
15 / 40
Retention
How many come back
after one week?
After ten weeks?
Can you spot any progress?
6
16 / 40
Intent
HistoryHistory
17 / 40
How toHow to
start?
18 / 40
No data?
Nothing to do here
Move to next skill
1
19 / 40
Unresolved
Utterances from the
last 30 days
Examine regularly
2
20 / 40
Low confidence
Start with utterances
with low confidence
Solve them on daily basis
3
21 / 40
Medium
confidence
Continue with utterances
with medium confidence
Be careful: they are trickier
Solve them on weekly basis
4
22 / 40
Resolve
utterances
Your interaction model
will be changed
Don't forget to certify
Don't forget to update
your backend if any
5
23 / 40
Bulk mapping
Map utterances in a bulk
Again: your interaction
model will be changed
6
24 / 40
ReviewsReviews
25 / 40
Don't be afraidDon't be afraid
of bad reviews!of bad reviews!
26 / 40
Positive reviews
Very nice!
Hard to use for
improvements.
1
27 / 40
Pure star reviews
Nice but almost useless.
2
28 / 40
Pure negative
reviews
Sad and almost useless.
3
29 / 40
Constructive
bad reviews
Very nice!
Very useful for
improvements!
Don't forget to write back!
4
30 / 40
New
Alexa
featuresfeatures
31 / 40
How to stayHow to stay
up to date?up to date?
32 / 40
Developer blog
Try new Alexa features
New Alexa features can
solve old problems
1
33 / 40
Newsletter
Get the developer
newsletter!
Both in German
and Englisch!
2
34 / 40
Conclusion
35 / 40
Project phases
Maintenance is the
longest project phase!
36 / 40
Metrics
Examine them
regularly and act!
37 / 40
Intent History
Improve your
interaction model
on regular basis!
38 / 40
Reviews
Use the power
of constructive
bad reviews!
39 / 40
New Alexa
features
Stay up to date
40 / 40
Thanks!
ralf@travello.audio
https://www.travello.audio
1 of 40

Recommended

Alexa, what's next? by
Alexa, what's next?Alexa, what's next?
Alexa, what's next?Ralf Eggert
311 views58 slides
Software User Interface Design Ergonomics by
Software User Interface Design ErgonomicsSoftware User Interface Design Ergonomics
Software User Interface Design ErgonomicsWasif Altaf
2.9K views17 slides
Solving Flaky Automated Tests Using Machine Learning by
Solving Flaky Automated Tests Using Machine LearningSolving Flaky Automated Tests Using Machine Learning
Solving Flaky Automated Tests Using Machine LearningJames Farrier
113 views42 slides
Machine Learning Vital Signs by
Machine Learning Vital SignsMachine Learning Vital Signs
Machine Learning Vital SignsDonald Miner
1.2K views27 slides
Adaptive Automation: Tests that Recover Instead of Failing by
Adaptive Automation: Tests that Recover Instead of FailingAdaptive Automation: Tests that Recover Instead of Failing
Adaptive Automation: Tests that Recover Instead of FailingTechWell
77 views28 slides
Defect root cause analysis, Андрей Титаренко by
Defect root cause analysis, Андрей ТитаренкоDefect root cause analysis, Андрей Титаренко
Defect root cause analysis, Андрей ТитаренкоSigma Software
332 views17 slides

More Related Content

Similar to Alexa Skill Maintenance

Usability Testing is Easy! by
Usability Testing is Easy!Usability Testing is Easy!
Usability Testing is Easy!Francis Rowland
1.5K views12 slides
Best Damn D-FMEA Method! by
Best Damn D-FMEA Method!Best Damn D-FMEA Method!
Best Damn D-FMEA Method!Michael Anleitner
16.6K views42 slides
Integrity Leadership Training by
Integrity Leadership TrainingIntegrity Leadership Training
Integrity Leadership TrainingRussell Cummings
1.7K views113 slides
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world by
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the worldAgile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the worldHiroyuki Ito
7.5K views60 slides
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world by
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world  Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world Rakuten Group, Inc.
786 views60 slides
5 reasons you'll love to hate Agile Development by
5 reasons you'll love to hate Agile Development5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile DevelopmentArin Sime
2.8K views46 slides

Similar to Alexa Skill Maintenance(20)

Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world by Hiroyuki Ito
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the worldAgile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Hiroyuki Ito7.5K views
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world by Rakuten Group, Inc.
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world  Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
5 reasons you'll love to hate Agile Development by Arin Sime
5 reasons you'll love to hate Agile Development5 reasons you'll love to hate Agile Development
5 reasons you'll love to hate Agile Development
Arin Sime2.8K views
Starting With Toyota 5s by okdennis
Starting With Toyota 5sStarting With Toyota 5s
Starting With Toyota 5s
okdennis10.8K views
Scaling Scrum using Lean/Kanban in Amdocs by Yuval Yeret
Scaling Scrum using Lean/Kanban in AmdocsScaling Scrum using Lean/Kanban in Amdocs
Scaling Scrum using Lean/Kanban in Amdocs
Yuval Yeret3.5K views
Testaus 2014 -seminaari: Arto Kiiskinen, Mirasys Oy. Case Mirasys: Toiminnoil... by Tieturi Oy
Testaus 2014 -seminaari: Arto Kiiskinen, Mirasys Oy. Case Mirasys: Toiminnoil...Testaus 2014 -seminaari: Arto Kiiskinen, Mirasys Oy. Case Mirasys: Toiminnoil...
Testaus 2014 -seminaari: Arto Kiiskinen, Mirasys Oy. Case Mirasys: Toiminnoil...
Tieturi Oy934 views
An Agile Way As an SET at LINE -Product Ownership Edition- by LINE Corporation
An Agile Way As an SET at LINE -Product Ownership Edition-An Agile Way As an SET at LINE -Product Ownership Edition-
An Agile Way As an SET at LINE -Product Ownership Edition-
LINE Corporation374 views
RealDolmen Atlassian Customer Immersion Event Slides by Peter Van de Voorde
RealDolmen Atlassian Customer Immersion Event SlidesRealDolmen Atlassian Customer Immersion Event Slides
RealDolmen Atlassian Customer Immersion Event Slides
Fixing Your OKRs With Agility – Agile Hartford by Yuval Yeret
Fixing Your OKRs With Agility – Agile HartfordFixing Your OKRs With Agility – Agile Hartford
Fixing Your OKRs With Agility – Agile Hartford
Yuval Yeret14 views
IIBA and Solvera May Event - Testing w Agile slides by SaskatchewanIIBA
IIBA and Solvera May Event - Testing w Agile slidesIIBA and Solvera May Event - Testing w Agile slides
IIBA and Solvera May Event - Testing w Agile slides
SaskatchewanIIBA336 views
Fixing Your OKRs With Agility – Agile Indy 2023 by Yuval Yeret
Fixing Your OKRs With Agility – Agile Indy 2023Fixing Your OKRs With Agility – Agile Indy 2023
Fixing Your OKRs With Agility – Agile Indy 2023
Yuval Yeret141 views
Training Webinar - Wireframing made easy by OutSystems
Training Webinar - Wireframing made easyTraining Webinar - Wireframing made easy
Training Webinar - Wireframing made easy
OutSystems1.5K views
JDD2014: Agile transformation - how to change minds, deliver amazing results ... by PROIDEA
JDD2014: Agile transformation - how to change minds, deliver amazing results ...JDD2014: Agile transformation - how to change minds, deliver amazing results ...
JDD2014: Agile transformation - how to change minds, deliver amazing results ...
PROIDEA315 views
A/B Testing Best Practices by Hulu Product Leader by Product School
A/B Testing Best Practices by Hulu Product LeaderA/B Testing Best Practices by Hulu Product Leader
A/B Testing Best Practices by Hulu Product Leader
Product School238 views

More from Ralf Eggert

ChatGPT: unser täglich' Bot gib uns heute by
ChatGPT: unser täglich' Bot gib uns heuteChatGPT: unser täglich' Bot gib uns heute
ChatGPT: unser täglich' Bot gib uns heuteRalf Eggert
5 views87 slides
Der ultimative PHP Framework Vergleich 2023 Edition by
Der ultimative PHP Framework Vergleich 2023 EditionDer ultimative PHP Framework Vergleich 2023 Edition
Der ultimative PHP Framework Vergleich 2023 EditionRalf Eggert
3 views79 slides
PHP Module als Rundum-Sorglos-Pakete entwickeln by
PHP Module als Rundum-Sorglos-Pakete entwickelnPHP Module als Rundum-Sorglos-Pakete entwickeln
PHP Module als Rundum-Sorglos-Pakete entwickelnRalf Eggert
70 views70 slides
Alexa, wohin geht die Reise by
Alexa, wohin geht die ReiseAlexa, wohin geht die Reise
Alexa, wohin geht die ReiseRalf Eggert
265 views26 slides
8. Hamburg Voice Interface Meetup by
8. Hamburg Voice Interface Meetup8. Hamburg Voice Interface Meetup
8. Hamburg Voice Interface MeetupRalf Eggert
199 views16 slides
Welcome Bixby by
Welcome BixbyWelcome Bixby
Welcome BixbyRalf Eggert
396 views44 slides

More from Ralf Eggert(20)

ChatGPT: unser täglich' Bot gib uns heute by Ralf Eggert
ChatGPT: unser täglich' Bot gib uns heuteChatGPT: unser täglich' Bot gib uns heute
ChatGPT: unser täglich' Bot gib uns heute
Ralf Eggert5 views
Der ultimative PHP Framework Vergleich 2023 Edition by Ralf Eggert
Der ultimative PHP Framework Vergleich 2023 EditionDer ultimative PHP Framework Vergleich 2023 Edition
Der ultimative PHP Framework Vergleich 2023 Edition
Ralf Eggert3 views
PHP Module als Rundum-Sorglos-Pakete entwickeln by Ralf Eggert
PHP Module als Rundum-Sorglos-Pakete entwickelnPHP Module als Rundum-Sorglos-Pakete entwickeln
PHP Module als Rundum-Sorglos-Pakete entwickeln
Ralf Eggert70 views
Alexa, wohin geht die Reise by Ralf Eggert
Alexa, wohin geht die ReiseAlexa, wohin geht die Reise
Alexa, wohin geht die Reise
Ralf Eggert265 views
8. Hamburg Voice Interface Meetup by Ralf Eggert
8. Hamburg Voice Interface Meetup8. Hamburg Voice Interface Meetup
8. Hamburg Voice Interface Meetup
Ralf Eggert199 views
Vom Zend Framework zu Laminas by Ralf Eggert
Vom Zend Framework zu LaminasVom Zend Framework zu Laminas
Vom Zend Framework zu Laminas
Ralf Eggert441 views
Alexa Skills und PHP? Passt das zusammen? by Ralf Eggert
Alexa Skills und PHP? Passt das zusammen?Alexa Skills und PHP? Passt das zusammen?
Alexa Skills und PHP? Passt das zusammen?
Ralf Eggert426 views
Mit Jovo von 0 auf 100 by Ralf Eggert
Mit Jovo von 0 auf 100Mit Jovo von 0 auf 100
Mit Jovo von 0 auf 100
Ralf Eggert477 views
Vom Zend Framework zu Laminas by Ralf Eggert
Vom Zend Framework zu LaminasVom Zend Framework zu Laminas
Vom Zend Framework zu Laminas
Ralf Eggert490 views
Alexa for Hospitality by Ralf Eggert
Alexa for HospitalityAlexa for Hospitality
Alexa for Hospitality
Ralf Eggert249 views
Alexa, lass uns Geld verdienen – fünf Geschäftsmodelle, die wirklich funktion... by Ralf Eggert
Alexa, lass uns Geld verdienen – fünf Geschäftsmodelle, die wirklich funktion...Alexa, lass uns Geld verdienen – fünf Geschäftsmodelle, die wirklich funktion...
Alexa, lass uns Geld verdienen – fünf Geschäftsmodelle, die wirklich funktion...
Ralf Eggert802 views
Fortgeschrittene Techniken für erfolgreiche Sprachanwendungen by Ralf Eggert
Fortgeschrittene Techniken für erfolgreiche SprachanwendungenFortgeschrittene Techniken für erfolgreiche Sprachanwendungen
Fortgeschrittene Techniken für erfolgreiche Sprachanwendungen
Ralf Eggert336 views
Die sieben Projektphasen für Voice Projekte by Ralf Eggert
Die sieben Projektphasen für Voice ProjekteDie sieben Projektphasen für Voice Projekte
Die sieben Projektphasen für Voice Projekte
Ralf Eggert332 views
Künstliche Intelligenz – Traum und Wirklichkeit by Ralf Eggert
Künstliche Intelligenz – Traum und WirklichkeitKünstliche Intelligenz – Traum und Wirklichkeit
Künstliche Intelligenz – Traum und Wirklichkeit
Ralf Eggert518 views
Multi-Modal Voice Development with Amazon Alexa by Ralf Eggert
Multi-Modal Voice Development with Amazon AlexaMulti-Modal Voice Development with Amazon Alexa
Multi-Modal Voice Development with Amazon Alexa
Ralf Eggert987 views
Mein Haus, mein Auto, mein Backend by Ralf Eggert
Mein Haus, mein Auto, mein BackendMein Haus, mein Auto, mein Backend
Mein Haus, mein Auto, mein Backend
Ralf Eggert171 views
Zend/Expressive 3 – The Next Generation by Ralf Eggert
Zend/Expressive 3 – The Next GenerationZend/Expressive 3 – The Next Generation
Zend/Expressive 3 – The Next Generation
Ralf Eggert364 views
Sieben Tipps für den Voice Commerce mit PHP by Ralf Eggert
Sieben Tipps für den Voice Commerce mit PHPSieben Tipps für den Voice Commerce mit PHP
Sieben Tipps für den Voice Commerce mit PHP
Ralf Eggert218 views
Multi Modal Voice Development with Amazon Alexa by Ralf Eggert
Multi Modal Voice Development with Amazon AlexaMulti Modal Voice Development with Amazon Alexa
Multi Modal Voice Development with Amazon Alexa
Ralf Eggert374 views

Recently uploaded

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveNetwork Automation Forum
31 views35 slides
Attacking IoT Devices from a Web Perspective - Linux Day by
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day Simone Onofri
16 views68 slides
Vertical User Stories by
Vertical User StoriesVertical User Stories
Vertical User StoriesMoisés Armani Ramírez
14 views16 slides
Zero to Automated in Under a Year by
Zero to Automated in Under a YearZero to Automated in Under a Year
Zero to Automated in Under a YearNetwork Automation Forum
15 views23 slides
STPI OctaNE CoE Brochure.pdf by
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdfmadhurjyapb
14 views1 slide

Recently uploaded(20)

Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Attacking IoT Devices from a Web Perspective - Linux Day by Simone Onofri
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day
Simone Onofri16 views
STPI OctaNE CoE Brochure.pdf by madhurjyapb
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdf
madhurjyapb14 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely21 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada136 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma39 views
Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2217 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana16 views
Empathic Computing: Delivering the Potential of the Metaverse by Mark Billinghurst
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
Mark Billinghurst478 views
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex22 views

Alexa Skill Maintenance