This document discusses task validation options in UserZoom usability testing. It introduces the four validation methods: via URL, via question, via video analysis, and via self-report. Each method is explained with examples of appropriate use cases. Best practices are also covered, such as having predefined success criteria and avoiding navigation tasks with URL validation. The webinar provides a demo of how each validation type can be built into a study and reviews tips for testing validation setups.

1. Tips and Tricks: Task Validation Options
UserZoom Onboarding Team
12/19/2017

2. Agenda
Introduction
Use Cases
UZ Manager Demo
Best Practices
1
2
3
4
US Contact: uz-onboarding@userzoom.com
Non US Contact: uz-onboarding-emea@userzoom.com
Andrea Peer
Rima
Campbell
Toni
Allen
Alex
Crocker

3. Quick Housekeeping
● Chat box is available if you have questions
● There will be time for Q&A at the end
● We will be recording the webinar for future
viewing. This material will be available on
demand here: UZ Education Series
● Additional information about these feature can
be found in the UserZoom Support Center

4. Task Validation Options
Today you will learn about you options in UserZoom to measure task
success
After this session you will be able to:
1
2
3
4
Know the 4 task validation options
Know when and how to use each of the 4 options
Know how to build the options into a study
Interpret the results from each of the 4 options

5. Task Validation on Navigation Tasks

6. What is Task Validation?
Task validation is connected to the concept of task success.
● Task success measure: Can the user accomplish the task as the product team intended?
● Task validation: The study design method to determine how success will be captured and measured
within a UserZoom study.
“Completion rates are the fundamental usability metric: A
binary measure of pass and fail (coded as 1 or 0) provides a
simple metric of success. If users cannot complete a task, not
much else matters with respect to usability or utility.”
Source: Sauro, https://measuringu.com/completion-rates/

7. 4 Options for Task Validation

8. 4 Task Validation Options
System
Human
Validation via URL
Validation via Question
Validation via Video Analysis
Validation via User Self Reported

9. Validation via URL

10. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of URL
Use Cases
● Exact URL: There is a specific place you want your users to land in a live site or a
prototype.
● Contains URL: There is a general area on the site or in the prototype the user need to be
that has a common thing in the URL path.
● Starts With URL: There is a general area on the site or in the prototype the user needs to
be that all start with the same URL path.
● Not Contains: The user shouldn’t be anywhere in the prototype or live site that contains
a part of a URL path.

11. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of URL
Use Cases
● Exact URL: There is a specific place you want your users to land in a live site or a
prototype.
Task: You are exploring the tool and services of UserZoom. On the next page, please speak
out loud what you think UserZoom does and how you would explain it to a colleague.
Success: https://www.userzoom.com/the-userzoom-advantage/

12. Let’s Zoom In!

13. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of URL
Use Cases
● Exact URL: There is a specific place you want your users to land in a live site or a prototype.

14. Actual Success Actual Non Success
User Thought They
Were Successful
Yeah!! False Positive
User Thought They
Were NOT Successful
False Negative Yeah! But Gotta Fix It
Let Them Keep Browsing

15. Let Them Keep Browsing
User Thought
they were
successful BUT
they were not
User Thought
they were NOT
successful and
they were not

16. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of
URL
Use Cases
● Contains URL: There is a general area on the site or in the
prototype the user need to be that has a common thing in
the URL path.
Task: In the SaaS world, the customer success model is an
important thing to understand when deciding which solution
to purchase. How does customer success work at UserZoom?
Success:
https://www.userzoom.com/customer-success/#partners-for-success
https://www.userzoom.com/customer-success/#meet-our-customers

17. Let’s Zoom In!

18. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of URL
Use Cases
● Starts With URL: There is a general area on the site or in the prototype the user needs to
be that all start with the same URL path.
Task:
Success: https://www.userzoom.com/resource-center/?post_types=post

19. Let’s Zoom In!

20. Use Cases for Validation via URL
Validation via URL: Did the user visit a specific URL or type of URL
Use Cases
● Not Contains: The user shouldn’t be anywhere in the prototype or live site that contains
a part of a URL path.
Task: What news has UserZoom been in?
Starting URL: https://www.userzoom.com/blog/categories/news-cat/
Success: https://www.userzoom.com/resource-center

21. Let’s Zoom In!

22. Validation via Question

23. Use Cases for Validation via URL
Validation via Question - Step 1: Create the validation question

24. Use Cases for Validation via URL
Validation via Question - Step 2: Create the conditions for success on ‘Task Settings & Validation’,
‘Validation’

25. Let’s Zoom In!

26. Validation via Video Analysis

27. Use Cases for Validation via URL
Validation via Video Analysis
Step 1: Create a mark for ‘Success’ and ‘Non Success’
Step 2: Mark each video
Step 3 (Optional): If you want the tasks to reflect what you have marked put in a help ticket to have
UserZoom recode the task success for you.

28. Let’s Zoom In!

29. Validation via User Self Reported

30. Use Cases for Validation via URL
Validation via User Self Reported
Task: Find the one thing that you think will help you make the case to purchase UserZoom for your
organization.
Success: Find the one thing that you think will help you make the case to purchase UserZoom for your
organization. Speak your answers out loud. If you are not able to find anything select 'Skip It'. Once
you have found that one thing select "I'm Done" or if you are unable to find the something select "Skip
It"

31. Let’s Zoom In!

32. Best Practices
with
Task Validation

33. ● Have pre-defined task success amongst your stakeholders
● Use “Contains” when using InVision prototypes
● Validation criteria uses an OR operator
Mistakes to avoid (because I’ve already made them for you)

34. Best Practices
● Script your study outside of UserZoom first
● Strive to identify system level validations when possible
● Choose “Let Them Continue Browsing” when using a validation option on a navigation task
● Test as a live participant using the invitation links and ensure the success data is captured the
way you want
○ Pro Tip: Create a segment for “internal testers” to use for colleagues to test as well

35. Q&A

36. Resources
Email your CSM or onboarding team for a copy of the two demo studies
● Study Name - TIPS AND TRICKS: Task Validation
○ Study ID: C5212S323
UserZoom Knowledgebase Support Articles on validation
● Validation via URL

37. THANK YOU
FOR JOINING TODAY’S WEBINAR!
Join us on October 10th at 8:00am PST for the next UserZoom
Webinar Series
Research Method Session on Screenshot Click Testing
Connect with uz-onboarding team:
US uz-onboarding@userzoom.com
non US: uz-onboarding-emea@userzoom.com
marketing@userzoom.co
m
US HQ: 866-599-1550