The document discusses tools for designing, building, testing, and launching Alexa skills. It provides guidance on voice design principles, handling synonyms, storing persistent user data, testing skills with real users, and using the Alexa Skills Kit and tools from Pulse Labs to streamline the development process. Skill testing is emphasized as important for gathering feedback from users to iterate on the design.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alexa Skill Developer Tools: Build
Better Skills Faster
Paul Cutsinger
Alexa and Echo at Amazon
Amazon.com
@AlexaDevs
A L X 4 0 6
Dylan Zwick
Chief Product Officer
Pulse Labs
@PulseLabsAI

3. “Conversational platforms will drive the next
big paradigm shift in how humans interact
with the digital world.”
Gartner Top 10 Strategic Technology Trends for 2018

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tooling for each stage of the skill lifecycle
Design Build Test Launch

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Designing for voice
Design Build Test Launch

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Core ideas in visual design
• Constrained user input
• Simultaneous presentation
• Persistent data
• Text input is hard

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Voice design is different
• Unconstrained user input
• Sequential presentation
• Ephemeral data
• Text input is easy

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visual design is constrained

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Voice design is unconstrained
Yes
Yeah
Uh huh
SureWhy not?

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dealing with synonyms
Cat
Kitty
Tabby
Grimalkin

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Entertainment adventure skill

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
I’ll have a whiskey
Give me a whiskey
Whiskey
Whiskey please
Whiskey for me
Serve up a whiskey
Pass me a whiskey
Intent
ServeDrink
Utterances and intents

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
{drink} Synonyms
Whiskey
Johnnie Walker, WhistlePig Boss
Hog, Bushmills
Tequila Don Julio, Ocho
Beer
Draft, cold one, libation, brewskie,
oat soda, cerveza, barley pop
Water
H2o, drink,
still gin and tonic hold the gin
Slots and entity resolution
I’ll have a {drink}
Give me a {drink}
{drink}
{drink} please
{drink} for me
Serve up a {drink}
Pass me a {drink}

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
People don’t only use one greeting
Hey!
Hi!
How’s it
going?
Hello!
Voice applications shouldn’t either!

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Random can be dangerous—Quiz skill

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Successful quiz skill:
• Stores score for the game
• Stores scores from previous games
• Stores times from previous games

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Wide top level UI, not nested menus
A
B
C
D

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Wide top level UI, not nested menus
A
B
C
D
A B C E
D

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example: Ticket ordering skill
Main Menu
Search Near me
Recommend
Coming
Soon
Title
Time
Search
!

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example: Food Re-Ordering Skill
Main Menu
Search
Change
Something
Change Pickup
Method
Change
Location
Place order
Change Order
Item
!

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Building for voice
Design Build Test Launch

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Skill management API and CLI

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Command line interface
$ npm install -g ask-cli

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
IDE integration

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS CodeStar

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Testing for voice
Design Build Test Launch

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

35. “Testing with real users, early
and often, is crucial”
Cathy Pearl, Designing Voice User Interfaces

36. “To design the best UX, pay attention to what
users do, not what they say. Self-reported claims
are unreliable, as are user speculations about
future behavior. Users do not know what they
want.” Jacob Nielsen, Nielsen Norman Group

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recruit testers
Rule of thumb:
The easier testers are to
recruit, the less valuable
their feedback
Difficulty to recruit
Valueoffeedback

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Onsite lab tests
Photo by Ani Kolleshi on Unsplash
• Coordination on time and
location
• Extensive pre-planning
• Artificial environment
• Expensive

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Offsite lab test
• Extensive equipment
logistics
• Hard to record the
interaction
• Data collection is tricky

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vetted panel of user testers
Large panel of testers in
• United States
• United Kingdom
• Canada
• Australia
Pulse Labs handles all coordination
and communication with testers

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Optimizing for voice
Design Build Test Launch

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Remember
Design Build Test Launch
• Be adaptable
• Be contextual
• Be available
• Test early and
often
• Unit test
• Beta test with
real users – Pulse
Labs can help!
• Skill
management
API
• AWS CLI
• IDE Integration
• Track your
performance
with Alexa
analytics tools

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alexa.design links
Design Build Test Launch
/design
/situational_design
/utterances
/synonyms
/memory
/handlers
/test
/unit_testing
/beta_testing
/pulselabs
/build
/smapi
/cli
/vscode
/codestar
/launch
/analytics

48. @PaulCutsingerDylan Zwick - dylan@pulselabs.ai
Amazon Alexa
Thank you!

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.