SlideShare a Scribd company logo
1 of 50
Download to read offline
User
Testing
Alvin Chai, Speaker
UX Indonesia – Malaysia 2014, 26th April 2014
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 2
Topics To Be Covered Today
1. Introduction
2. Ways of Doing User Testing
3. Case Studies
4. When to Test
5. Demo
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 3
Introduction
• What is user testing?
source:static.pb.pl/picture/40479,40918/f663x450
Introduction
• A method by which users are asked to perform
certain tasks in an effort to measure the
product’s user friendliness, task time, and how
user feel about the usage experience.
• Think Aloud!
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 5
User Testing For The Digital World
Test websites/apps to find usability issues
(where users are confused, why they are leaving)
UX Myth
“YOU know a lot about your service &
website, you are passionate about it.”
“Your USER doesn’t
necessarily care.”
YOU are NOT your USER
no matter how good you think you are
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 7
2 Ways of Doing Usability Testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 8
(i) In Person Testing
2 Ways of Usability Testing
(ii) Online User Testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 11
1. Set up test questions
2. Look for participants
3. Arrange time to come in and availability of
user and facilitator
4. Wait for everyone to finish
5. Collect test results
6. Analyse test results
7. Reporting
(i) In Person Testing Cycle
3-4 weeks
(ii) Online Usability Testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 13
An Online Testing Cycle
1. Test Instruction
2. Testing with Users
3. Research & Analysis
6-7 days
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 14
Faster & Lower Cost & Natural
Online Tester Matching
Customers
Internet + Software
You
TT T
T T
Online Usability Testing Software
TT
T T
Example of Online Usability Testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 17
Converting All User Experience Into
Useful Marketing Data
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 18
Education E-commerce Web Portal Entertainment
Some Of The Companies That We Help To Do Online User Testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 19
Quality Assurance
Evidence Based
Understanding Users
Empowerment
Increase Loyalty
Value of user
testing
Difference Between Testing Methods?
Quantitative Qualitative
Google Analytics, Heat
map, A/B Testing
User Testing (UX Testing)
Quantitative method tells you
how many people come to the
website, how many leave, how
much time they stay on your
website etc.
Qualitative method tells you why
people are leaving and the
reasons why users behave in a
particular way. Both Quantitative
and Qualitative methods are
complementary to each other.
You will need both methods to
have a better understanding of
your user’s behavior.
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 21
Case Studies:
User Testing Conducted Using Online Software
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 22
Case Study 1
Car Maker Websites Review 2013
Industrial Review
85 user testing sessions
1 month
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 26
Service Centre & Sales Outlet
Before
After
Using The Right Colours For Easy Reading
Before
No Map for Sales & Service Outlets
No Map for Sales & Service Outlets
After
Under The Sea Showroom
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 31
Case Study 2
Singapore
National Day Rally 2013
Website
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 33
Which Design is the Best Based On User Testing?
The Winning Design
120% more engaging
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 35
Case Study 3
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 36
Mobile Apps Experience Testing
The button design is
not immediately
obvious to the user
as a ‘bookmark’
function.
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 38
Quality Assurance
Evidence Based
Understanding Users
Empowerment
Increase Loyalty
Value of user
testing
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 39
When to Test?
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 40
What Stages To Do User Research & Testing?
1. Research &
Planning
2. Low-fi &
High-fi Designs
3. Prototype
4. Development
5. Staging6. Pre Launch
7. Post Launch
& Monitoring
Continuous Improvement
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 41
Testing on Competitors
User testing helps you benchmark your website and other competitor websites.
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 42
Prototype User Testing
User testing helps you to learn about any critical issues with your user journey early on.
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 43
1. If you want a great product, you have got
to test.
2. Testing is a repeating process.
3. Testing with 1 user is better than none.
4. Testing with 1 user is better than testing
with 100 users near the end.
5. Testing insights will allow you to make
informed decision.
Facts to Remember
How to plan test instruction?
1. Task oriented
How to plan test instruction?
2. Non-leading questions
Non-leading: Try to buy plane tickets for
your family vacation.
Leading: Press the red button and then
click the 1st top left button with a airplane
icon…
How Many Testers Do You Need?
Source:media.nngroup.com/media/editor/alertbox/20000319-user-testing-diminshing-returns-curve.gif
Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved.
All other trademarks, logos and copyrights are the property of their respective owners. 47
Live Demo
Any volunteer? It will be fun!
Being a Tester
1. Think Aloud
2. Say the Truth
3. It not testing your IQ
4. Give Suggestion
5. Say What You Like / Don’t Like
Moderator’s Role
1. Tour guide
2. Interrupt only when necessary
3. Don’t answer questions for tester
4. Ask questions starting with“What”or
“How”if tester becomes quiet
Q&A
Winner of People’s Choice Award
of Global Innovation through Science & Technology by the U.S. Department of State
Media
Coverage
Online User Testing Software
Terima Kasih
Email & LinkedIn: alvin@netizentesting.com

More Related Content

What's hot

General UX activities & process overview
General UX activities & process overviewGeneral UX activities & process overview
General UX activities & process overviewBen Melbourne
 
User Experience (UX) Overview
User Experience (UX) OverviewUser Experience (UX) Overview
User Experience (UX) OverviewBernard Schokman
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Domain7
 
Ubuntu Usability Test Report
Ubuntu Usability Test ReportUbuntu Usability Test Report
Ubuntu Usability Test ReportDan Fitek
 
An Introduction to User Experience (UX) Fundamentals
An Introduction to User Experience (UX) FundamentalsAn Introduction to User Experience (UX) Fundamentals
An Introduction to User Experience (UX) FundamentalsChris LaRoche
 
JScaff_webster_leiden_ux_overview
JScaff_webster_leiden_ux_overviewJScaff_webster_leiden_ux_overview
JScaff_webster_leiden_ux_overviewJulian Scaff
 
A Practical Approach to Great User Adoption User Definition & User Interface ...
A Practical Approach to Great User Adoption User Definition & User Interface ...A Practical Approach to Great User Adoption User Definition & User Interface ...
A Practical Approach to Great User Adoption User Definition & User Interface ...Damon Sanchez
 
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...Use8.net
 
UserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: FareportalUserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: FareportalUserTesting
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
User Experience Design & Paper Prototyping
User Experience Design & Paper PrototypingUser Experience Design & Paper Prototyping
User Experience Design & Paper PrototypingIlona Posner
 
Heuristic evaluation
Heuristic evaluationHeuristic evaluation
Heuristic evaluationGaurav Bhatia
 
User Experience Masterclass 101 with Mark Swaine
User Experience Masterclass 101 with Mark SwaineUser Experience Masterclass 101 with Mark Swaine
User Experience Masterclass 101 with Mark SwaineMark N Swaine
 
Visualising the User Experience
Visualising the User ExperienceVisualising the User Experience
Visualising the User ExperienceGrant Robinson
 

What's hot (20)

Web Usability
Web UsabilityWeb Usability
Web Usability
 
General UX activities & process overview
General UX activities & process overviewGeneral UX activities & process overview
General UX activities & process overview
 
User Experience (UX) Overview
User Experience (UX) OverviewUser Experience (UX) Overview
User Experience (UX) Overview
 
Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?Usability vs. User Experience: What's the difference?
Usability vs. User Experience: What's the difference?
 
Ubuntu Usability Test Report
Ubuntu Usability Test ReportUbuntu Usability Test Report
Ubuntu Usability Test Report
 
An Introduction to User Experience (UX) Fundamentals
An Introduction to User Experience (UX) FundamentalsAn Introduction to User Experience (UX) Fundamentals
An Introduction to User Experience (UX) Fundamentals
 
JScaff_webster_leiden_ux_overview
JScaff_webster_leiden_ux_overviewJScaff_webster_leiden_ux_overview
JScaff_webster_leiden_ux_overview
 
Why Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing StrategyWhy Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing Strategy
 
A Practical Approach to Great User Adoption User Definition & User Interface ...
A Practical Approach to Great User Adoption User Definition & User Interface ...A Practical Approach to Great User Adoption User Definition & User Interface ...
A Practical Approach to Great User Adoption User Definition & User Interface ...
 
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...
Serco Usability Research, Ben Weedon, The challenge of measuring game play ex...
 
UserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: FareportalUserTesting Webinar - UX in Action: Fareportal
UserTesting Webinar - UX in Action: Fareportal
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
Ux
Ux Ux
Ux
 
User Experience Design & Paper Prototyping
User Experience Design & Paper PrototypingUser Experience Design & Paper Prototyping
User Experience Design & Paper Prototyping
 
Heuristic evaluation
Heuristic evaluationHeuristic evaluation
Heuristic evaluation
 
Heuristic evaluation
Heuristic evaluationHeuristic evaluation
Heuristic evaluation
 
UX Design Project
UX Design ProjectUX Design Project
UX Design Project
 
Introduction to UX Research
Introduction to UX ResearchIntroduction to UX Research
Introduction to UX Research
 
User Experience Masterclass 101 with Mark Swaine
User Experience Masterclass 101 with Mark SwaineUser Experience Masterclass 101 with Mark Swaine
User Experience Masterclass 101 with Mark Swaine
 
Visualising the User Experience
Visualising the User ExperienceVisualising the User Experience
Visualising the User Experience
 

Viewers also liked

Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)
Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)
Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)alvinc33
 
Startup/Digital Marketing 2.0: Growth Hacking Thru UX
Startup/Digital Marketing 2.0: Growth Hacking Thru UXStartup/Digital Marketing 2.0: Growth Hacking Thru UX
Startup/Digital Marketing 2.0: Growth Hacking Thru UXSoon-Aik Chiew
 
Emerging Markets and User Research - Apala Chavan
Emerging Markets and User Research - Apala ChavanEmerging Markets and User Research - Apala Chavan
Emerging Markets and User Research - Apala ChavanSTC India UX SIG
 
User Testing- guiding the way to success
User Testing- guiding the way to successUser Testing- guiding the way to success
User Testing- guiding the way to successDMI
 
User testing workshop
User testing workshopUser testing workshop
User testing workshopRed Badger
 
HFI Practical Usability Testing Certificate
HFI Practical Usability Testing CertificateHFI Practical Usability Testing Certificate
HFI Practical Usability Testing CertificateKarabo Ngoatle
 
User Testing for Accessibility
User Testing for AccessibilityUser Testing for Accessibility
User Testing for AccessibilityUsability Matters
 
Usability Testing
Usability TestingUsability Testing
Usability TestingAndy Budd
 
Selfish Accessibility: UXSG 2014
Selfish Accessibility: UXSG 2014Selfish Accessibility: UXSG 2014
Selfish Accessibility: UXSG 2014Adrian Roselli
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introductionElizabeth Snowdon
 

Viewers also liked (11)

Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)
Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)
Crafting Commercially Effective Mobile UX (@Echelon Indonesia 2015)
 
Startup/Digital Marketing 2.0: Growth Hacking Thru UX
Startup/Digital Marketing 2.0: Growth Hacking Thru UXStartup/Digital Marketing 2.0: Growth Hacking Thru UX
Startup/Digital Marketing 2.0: Growth Hacking Thru UX
 
Emerging Markets and User Research - Apala Chavan
Emerging Markets and User Research - Apala ChavanEmerging Markets and User Research - Apala Chavan
Emerging Markets and User Research - Apala Chavan
 
User Testing- guiding the way to success
User Testing- guiding the way to successUser Testing- guiding the way to success
User Testing- guiding the way to success
 
User testing workshop
User testing workshopUser testing workshop
User testing workshop
 
HFI Practical Usability Testing Certificate
HFI Practical Usability Testing CertificateHFI Practical Usability Testing Certificate
HFI Practical Usability Testing Certificate
 
User Testing for Accessibility
User Testing for AccessibilityUser Testing for Accessibility
User Testing for Accessibility
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Selfish Accessibility: UXSG 2014
Selfish Accessibility: UXSG 2014Selfish Accessibility: UXSG 2014
Selfish Accessibility: UXSG 2014
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introduction
 
Pepsico ppt
Pepsico pptPepsico ppt
Pepsico ppt
 

Similar to User Testing Guide by Alvin Chai

Training Opportunity: Certified Mobile App Professional (CMAP) Testing
Training Opportunity: Certified Mobile App Professional (CMAP) TestingTraining Opportunity: Certified Mobile App Professional (CMAP) Testing
Training Opportunity: Certified Mobile App Professional (CMAP) TestingITpreneurs
 
What does UX mean to the BA community?
What does UX mean to the BA community?What does UX mean to the BA community?
What does UX mean to the BA community?IIBA UK Chapter
 
Crucial Factors for Determining The Right Testing Method for Software Testing...
Crucial Factors for Determining The Right Testing Method for Software Testing...Crucial Factors for Determining The Right Testing Method for Software Testing...
Crucial Factors for Determining The Right Testing Method for Software Testing...Matthew Allen
 
Validating hypotheses with user research
Validating hypotheses with user researchValidating hypotheses with user research
Validating hypotheses with user researchgabrieljonsson
 
The Survey Says: Testers Spend Their Time Doing...
The Survey Says: Testers Spend Their Time Doing...The Survey Says: Testers Spend Their Time Doing...
The Survey Says: Testers Spend Their Time Doing...TechWell
 
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDRemote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDBecome Customer-Centric
 
Introduce Test Harness for Direct To Consumer Solutions.pdf
Introduce Test Harness for Direct To Consumer Solutions.pdfIntroduce Test Harness for Direct To Consumer Solutions.pdf
Introduce Test Harness for Direct To Consumer Solutions.pdfKnoldus Inc.
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility
 
Usability Testing Services Powered by Calidad Infotech.pptx
Usability Testing Services Powered by Calidad Infotech.pptxUsability Testing Services Powered by Calidad Infotech.pptx
Usability Testing Services Powered by Calidad Infotech.pptxCalidad Infotech
 
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...GoQA
 
2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC history2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC historyJonathan Hassell
 
Effective User Research - Silicon Valley Product Camp 2019
Effective User Research - Silicon Valley Product Camp 2019Effective User Research - Silicon Valley Product Camp 2019
Effective User Research - Silicon Valley Product Camp 2019UXReactor
 
A Successful Software Testing Career Path.pdf
A Successful Software Testing Career Path.pdfA Successful Software Testing Career Path.pdf
A Successful Software Testing Career Path.pdfKajal Digital
 
Inner-Source: The Lesson of Linux for Enterprises
Inner-Source: The Lesson of Linux for EnterprisesInner-Source: The Lesson of Linux for Enterprises
Inner-Source: The Lesson of Linux for EnterprisesSamsung Open Source Group
 
11 - Evaluating Framework in Interaction Design_new.pptx
11 - Evaluating Framework in Interaction Design_new.pptx11 - Evaluating Framework in Interaction Design_new.pptx
11 - Evaluating Framework in Interaction Design_new.pptxZahirahZairul2
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajSivaprasath Selvaraj
 

Similar to User Testing Guide by Alvin Chai (20)

Training Opportunity: Certified Mobile App Professional (CMAP) Testing
Training Opportunity: Certified Mobile App Professional (CMAP) TestingTraining Opportunity: Certified Mobile App Professional (CMAP) Testing
Training Opportunity: Certified Mobile App Professional (CMAP) Testing
 
Online Assessments Solution Vietnam
Online Assessments Solution VietnamOnline Assessments Solution Vietnam
Online Assessments Solution Vietnam
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
What does UX mean to the BA community?
What does UX mean to the BA community?What does UX mean to the BA community?
What does UX mean to the BA community?
 
Crucial Factors for Determining The Right Testing Method for Software Testing...
Crucial Factors for Determining The Right Testing Method for Software Testing...Crucial Factors for Determining The Right Testing Method for Software Testing...
Crucial Factors for Determining The Right Testing Method for Software Testing...
 
Validating hypotheses with user research
Validating hypotheses with user researchValidating hypotheses with user research
Validating hypotheses with user research
 
The Survey Says: Testers Spend Their Time Doing...
The Survey Says: Testers Spend Their Time Doing...The Survey Says: Testers Spend Their Time Doing...
The Survey Says: Testers Spend Their Time Doing...
 
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWDRemote v Moderated Usability Testing - by Paul Rouke from PRWD
Remote v Moderated Usability Testing - by Paul Rouke from PRWD
 
Introduce Test Harness for Direct To Consumer Solutions.pdf
Introduce Test Harness for Direct To Consumer Solutions.pdfIntroduce Test Harness for Direct To Consumer Solutions.pdf
Introduce Test Harness for Direct To Consumer Solutions.pdf
 
Usability Testing.docx
Usability Testing.docxUsability Testing.docx
Usability Testing.docx
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User Testing
 
Usability Testing Services Powered by Calidad Infotech.pptx
Usability Testing Services Powered by Calidad Infotech.pptxUsability Testing Services Powered by Calidad Infotech.pptx
Usability Testing Services Powered by Calidad Infotech.pptx
 
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...
КАТЕРИНА АБЗЯТОВА «Тестування мобільних додатків: Як створити виграшну страте...
 
The case for usability
The case for usabilityThe case for usability
The case for usability
 
2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC history2009: Maturing in accessibility - a brief BBC history
2009: Maturing in accessibility - a brief BBC history
 
Effective User Research - Silicon Valley Product Camp 2019
Effective User Research - Silicon Valley Product Camp 2019Effective User Research - Silicon Valley Product Camp 2019
Effective User Research - Silicon Valley Product Camp 2019
 
A Successful Software Testing Career Path.pdf
A Successful Software Testing Career Path.pdfA Successful Software Testing Career Path.pdf
A Successful Software Testing Career Path.pdf
 
Inner-Source: The Lesson of Linux for Enterprises
Inner-Source: The Lesson of Linux for EnterprisesInner-Source: The Lesson of Linux for Enterprises
Inner-Source: The Lesson of Linux for Enterprises
 
11 - Evaluating Framework in Interaction Design_new.pptx
11 - Evaluating Framework in Interaction Design_new.pptx11 - Evaluating Framework in Interaction Design_new.pptx
11 - Evaluating Framework in Interaction Design_new.pptx
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath Selvaraj
 

Recently uploaded

IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119APNIC
 
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119APNIC
 
Power of Social Media for E-commerce.pdf
Power of Social Media for E-commerce.pdfPower of Social Media for E-commerce.pdf
Power of Social Media for E-commerce.pdfrajats19920
 
draft-harrison-sidrops-manifest-number-01, presented at IETF 119
draft-harrison-sidrops-manifest-number-01, presented at IETF 119draft-harrison-sidrops-manifest-number-01, presented at IETF 119
draft-harrison-sidrops-manifest-number-01, presented at IETF 119APNIC
 
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119Is DNS ready for IPv6, presented by Geoff Huston at IETF 119
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119APNIC
 
Tari Eason Warriors Come Out To Play T Shirts
Tari Eason Warriors Come Out To Play T ShirtsTari Eason Warriors Come Out To Play T Shirts
Tari Eason Warriors Come Out To Play T Shirtsrahman018755
 
Summary IGF 2013 Bali - English (tata kelola internet / internet governance)
Summary  IGF 2013 Bali - English (tata kelola internet / internet governance)Summary  IGF 2013 Bali - English (tata kelola internet / internet governance)
Summary IGF 2013 Bali - English (tata kelola internet / internet governance)ICT Watch - Indonesia
 
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...vmzoxnx5
 
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119APNIC
 
Summary ID-IGF 2016 National Dialogue - English (tata kelola internet / int...
Summary  ID-IGF 2016 National Dialogue  - English (tata kelola internet / int...Summary  ID-IGF 2016 National Dialogue  - English (tata kelola internet / int...
Summary ID-IGF 2016 National Dialogue - English (tata kelola internet / int...ICT Watch - Indonesia
 
Basic Security.pptx is a awsome PPT on your mobiel
Basic Security.pptx is a awsome PPT on your mobielBasic Security.pptx is a awsome PPT on your mobiel
Basic Security.pptx is a awsome PPT on your mobielpratamakiki860
 

Recently uploaded (11)

IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119
 
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119
Making an RFC in Today's IETF, presented by Geoff Huston at IETF 119
 
Power of Social Media for E-commerce.pdf
Power of Social Media for E-commerce.pdfPower of Social Media for E-commerce.pdf
Power of Social Media for E-commerce.pdf
 
draft-harrison-sidrops-manifest-number-01, presented at IETF 119
draft-harrison-sidrops-manifest-number-01, presented at IETF 119draft-harrison-sidrops-manifest-number-01, presented at IETF 119
draft-harrison-sidrops-manifest-number-01, presented at IETF 119
 
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119Is DNS ready for IPv6, presented by Geoff Huston at IETF 119
Is DNS ready for IPv6, presented by Geoff Huston at IETF 119
 
Tari Eason Warriors Come Out To Play T Shirts
Tari Eason Warriors Come Out To Play T ShirtsTari Eason Warriors Come Out To Play T Shirts
Tari Eason Warriors Come Out To Play T Shirts
 
Summary IGF 2013 Bali - English (tata kelola internet / internet governance)
Summary  IGF 2013 Bali - English (tata kelola internet / internet governance)Summary  IGF 2013 Bali - English (tata kelola internet / internet governance)
Summary IGF 2013 Bali - English (tata kelola internet / internet governance)
 
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...
办理澳洲USYD文凭证书学历认证【Q微/1954292140】办理悉尼大学毕业证书真实成绩单GPA修改/办理澳洲大学文凭证书Offer录取通知书/在读证明...
 
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119
IPv6 Operational Issues (with DNS), presented by Geoff Huston at IETF 119
 
Summary ID-IGF 2016 National Dialogue - English (tata kelola internet / int...
Summary  ID-IGF 2016 National Dialogue  - English (tata kelola internet / int...Summary  ID-IGF 2016 National Dialogue  - English (tata kelola internet / int...
Summary ID-IGF 2016 National Dialogue - English (tata kelola internet / int...
 
Basic Security.pptx is a awsome PPT on your mobiel
Basic Security.pptx is a awsome PPT on your mobielBasic Security.pptx is a awsome PPT on your mobiel
Basic Security.pptx is a awsome PPT on your mobiel
 

User Testing Guide by Alvin Chai

  • 1. User Testing Alvin Chai, Speaker UX Indonesia – Malaysia 2014, 26th April 2014
  • 2. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 2 Topics To Be Covered Today 1. Introduction 2. Ways of Doing User Testing 3. Case Studies 4. When to Test 5. Demo
  • 3. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 3 Introduction • What is user testing? source:static.pb.pl/picture/40479,40918/f663x450
  • 4. Introduction • A method by which users are asked to perform certain tasks in an effort to measure the product’s user friendliness, task time, and how user feel about the usage experience. • Think Aloud!
  • 5. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 5 User Testing For The Digital World Test websites/apps to find usability issues (where users are confused, why they are leaving)
  • 6. UX Myth “YOU know a lot about your service & website, you are passionate about it.” “Your USER doesn’t necessarily care.” YOU are NOT your USER no matter how good you think you are
  • 7. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 7 2 Ways of Doing Usability Testing
  • 8. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 8 (i) In Person Testing 2 Ways of Usability Testing (ii) Online User Testing
  • 9. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 11 1. Set up test questions 2. Look for participants 3. Arrange time to come in and availability of user and facilitator 4. Wait for everyone to finish 5. Collect test results 6. Analyse test results 7. Reporting (i) In Person Testing Cycle 3-4 weeks
  • 11. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 13 An Online Testing Cycle 1. Test Instruction 2. Testing with Users 3. Research & Analysis 6-7 days
  • 12. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 14 Faster & Lower Cost & Natural Online Tester Matching Customers
  • 13. Internet + Software You TT T T T Online Usability Testing Software TT T T
  • 14. Example of Online Usability Testing
  • 15. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 17 Converting All User Experience Into Useful Marketing Data
  • 16. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 18 Education E-commerce Web Portal Entertainment Some Of The Companies That We Help To Do Online User Testing
  • 17. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 19 Quality Assurance Evidence Based Understanding Users Empowerment Increase Loyalty Value of user testing
  • 18. Difference Between Testing Methods? Quantitative Qualitative Google Analytics, Heat map, A/B Testing User Testing (UX Testing) Quantitative method tells you how many people come to the website, how many leave, how much time they stay on your website etc. Qualitative method tells you why people are leaving and the reasons why users behave in a particular way. Both Quantitative and Qualitative methods are complementary to each other. You will need both methods to have a better understanding of your user’s behavior.
  • 19. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 21 Case Studies: User Testing Conducted Using Online Software
  • 20. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 22 Case Study 1
  • 21. Car Maker Websites Review 2013
  • 23. 85 user testing sessions 1 month
  • 24. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 26 Service Centre & Sales Outlet
  • 25. Before After Using The Right Colours For Easy Reading
  • 26. Before No Map for Sales & Service Outlets
  • 27. No Map for Sales & Service Outlets After
  • 28. Under The Sea Showroom
  • 29. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 31 Case Study 2
  • 31. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 33 Which Design is the Best Based On User Testing?
  • 32. The Winning Design 120% more engaging
  • 33. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 35 Case Study 3
  • 34. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 36
  • 35. Mobile Apps Experience Testing The button design is not immediately obvious to the user as a ‘bookmark’ function.
  • 36. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 38 Quality Assurance Evidence Based Understanding Users Empowerment Increase Loyalty Value of user testing
  • 37. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 39 When to Test?
  • 38. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 40 What Stages To Do User Research & Testing? 1. Research & Planning 2. Low-fi & High-fi Designs 3. Prototype 4. Development 5. Staging6. Pre Launch 7. Post Launch & Monitoring Continuous Improvement
  • 39. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 41 Testing on Competitors User testing helps you benchmark your website and other competitor websites.
  • 40. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 42 Prototype User Testing User testing helps you to learn about any critical issues with your user journey early on.
  • 41. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 43 1. If you want a great product, you have got to test. 2. Testing is a repeating process. 3. Testing with 1 user is better than none. 4. Testing with 1 user is better than testing with 100 users near the end. 5. Testing insights will allow you to make informed decision. Facts to Remember
  • 42. How to plan test instruction? 1. Task oriented
  • 43. How to plan test instruction? 2. Non-leading questions Non-leading: Try to buy plane tickets for your family vacation. Leading: Press the red button and then click the 1st top left button with a airplane icon…
  • 44. How Many Testers Do You Need? Source:media.nngroup.com/media/editor/alertbox/20000319-user-testing-diminshing-returns-curve.gif
  • 45. Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 47 Live Demo Any volunteer? It will be fun!
  • 46. Being a Tester 1. Think Aloud 2. Say the Truth 3. It not testing your IQ 4. Give Suggestion 5. Say What You Like / Don’t Like
  • 47. Moderator’s Role 1. Tour guide 2. Interrupt only when necessary 3. Don’t answer questions for tester 4. Ask questions starting with“What”or “How”if tester becomes quiet
  • 48. Q&A
  • 49. Winner of People’s Choice Award of Global Innovation through Science & Technology by the U.S. Department of State Media Coverage Online User Testing Software
  • 50. Terima Kasih Email & LinkedIn: alvin@netizentesting.com