This document summarizes a presentation about user testing. It discusses: 1. What user testing is and its purpose of measuring usability, task time, and user experience. 2. The two main ways of conducting user testing - in person and online. Online testing allows for faster turnaround, lower costs, and more natural testing than in-person. 3. Examples of case studies where online user testing helped improve websites and apps by identifying usability issues and determining the most engaging design. 4. The various stages in a product lifecycle where user testing provides value, such as during prototyping, development, and post-launch monitoring.

1. User
Testing
Alvin Chai, Speaker
UX Indonesia – Malaysia 2014, 26th April 2014

2. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 2
Topics To Be Covered Today
1. Introduction
2. Ways of Doing User Testing
3. Case Studies
4. When to Test
5. Demo

3. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 3
Introduction
• What is user testing?
source:static.pb.pl/picture/40479,40918/f663x450

4. Introduction
• A method by which users are asked to perform
certain tasks in an effort to measure the
product’s user friendliness, task time, and how
user feel about the usage experience.
• Think Aloud!

5. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 5
User Testing For The Digital World
Test websites/apps to find usability issues
(where users are confused, why they are leaving)

6. UX Myth
“YOU know a lot about your service &
website, you are passionate about it.”
“Your USER doesn’t
necessarily care.”
YOU are NOT your USER
no matter how good you think you are

7. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 7
2 Ways of Doing Usability Testing

8. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 8
(i) In Person Testing
2 Ways of Usability Testing
(ii) Online User Testing

9. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 11
1. Set up test questions
2. Look for participants
3. Arrange time to come in and availability of
user and facilitator
4. Wait for everyone to finish
5. Collect test results
6. Analyse test results
7. Reporting
(i) In Person Testing Cycle
3-4 weeks

10. (ii) Online Usability Testing

11. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 13
An Online Testing Cycle
1. Test Instruction
2. Testing with Users
3. Research & Analysis
6-7 days

12. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 14
Faster & Lower Cost & Natural
Online Tester Matching
Customers

13. Internet + Software
You
TT T
T T
Online Usability Testing Software
TT
T T

14. Example of Online Usability Testing

15. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 17
Converting All User Experience Into
Useful Marketing Data

16. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 18
Education E-commerce Web Portal Entertainment
Some Of The Companies That We Help To Do Online User Testing

17. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 19
Quality Assurance
Evidence Based
Understanding Users
Empowerment
Increase Loyalty
Value of user
testing

18. Difference Between Testing Methods?
Quantitative Qualitative
Google Analytics, Heat
map, A/B Testing
User Testing (UX Testing)
Quantitative method tells you
how many people come to the
website, how many leave, how
much time they stay on your
website etc.
Qualitative method tells you why
people are leaving and the
reasons why users behave in a
particular way. Both Quantitative
and Qualitative methods are
complementary to each other.
You will need both methods to
have a better understanding of
your user’s behavior.

19. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 21
Case Studies:
User Testing Conducted Using Online Software

20. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 22
Case Study 1

21. Car Maker Websites Review 2013

22. Industrial Review

23. 85 user testing sessions
1 month

24. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 26
Service Centre & Sales Outlet

25. Before
After
Using The Right Colours For Easy Reading

26. Before
No Map for Sales & Service Outlets

27. No Map for Sales & Service Outlets
After

28. Under The Sea Showroom

29. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 31
Case Study 2

30. Singapore
National Day Rally 2013
Website

31. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 33
Which Design is the Best Based On User Testing?

32. The Winning Design
120% more engaging

33. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 35
Case Study 3

34. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 36

35. Mobile Apps Experience Testing
The button design is
not immediately
obvious to the user
as a ‘bookmark’
function.

36. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 38
Quality Assurance
Evidence Based
Understanding Users
Empowerment
Increase Loyalty
Value of user
testing

37. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 39
When to Test?

38. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 40
What Stages To Do User Research & Testing?
1. Research &
Planning
2. Low-fi &
High-fi Designs
3. Prototype
4. Development
5. Staging6. Pre Launch
7. Post Launch
& Monitoring
Continuous Improvement

39. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 41
Testing on Competitors
User testing helps you benchmark your website and other competitor websites.

40. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 42
Prototype User Testing
User testing helps you to learn about any critical issues with your user journey early on.

41. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 43
1. If you want a great product, you have got
to test.
2. Testing is a repeating process.
3. Testing with 1 user is better than none.
4. Testing with 1 user is better than testing
with 100 users near the end.
5. Testing insights will allow you to make
informed decision.
Facts to Remember

42. How to plan test instruction?
1. Task oriented

43. How to plan test instruction?
2. Non-leading questions
Non-leading: Try to buy plane tickets for
your family vacation.
Leading: Press the red button and then
click the 1st top left button with a airplane
icon…

44. How Many Testers Do You Need?
Source:media.nngroup.com/media/editor/alertbox/20000319-user-testing-diminshing-returns-curve.gif

45. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 47
Live Demo
Any volunteer? It will be fun!

46. Being a Tester
1. Think Aloud
2. Say the Truth
3. It not testing your IQ
4. Give Suggestion
5. Say What You Like / Don’t Like

47. Moderator’s Role
1. Tour guide
2. Interrupt only when necessary
3. Don’t answer questions for tester
4. Ask questions starting with“What”or
“How”if tester becomes quiet

48. Q&A

49. Winner of People’s Choice Award
of Global Innovation through Science & Technology by the U.S. Department of State
Media
Coverage
Online User Testing Software

50. Terima Kasih
Email & LinkedIn: alvin@netizentesting.com