Getting Roi Numbers From Ut Des Moines10 Sept09

•Download as PPT, PDF•

0 likes•500 views

John Sorflaten, PhD, CUXP

How to make usability more meaningful to your business measures

Getting ROI Numbers from Usability Testing John Sorflaten , PhD Certified Professional Ergonomist (CPE) Certified Usability Analyst (CUA) “ Midwife to successful web and application design” User testing, analysis, strategy, eCommerce, mobile apps User Experience Works http://www.linkedin.com/in/johnsorflaten (see SlideShare) www.userexperienceworks.com www.iphoneroi.com 641-455-1873

Overview ,[object Object],[object Object],[object Object],[object Object],[object Object]

1. Beyond “More” and “Less” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Use these free ROI calculators… ,[object Object]

ROI Calculator — Increased Productivity… ,[object Object]

2. Remember:“Margin of Error” ,[object Object],[object Object],[object Object],[object Object]

3. Use “Time-on-Task” for ROI ,[object Object],[object Object],[object Object],http://www.measuringusability.com/time_intervals.php

4. Go for the “lower bound”… ,[object Object],Finally, success…

Converting UT Results to Business Measures ,[object Object],[object Object],[object Object],[object Object],[object Object]

1. Effectiveness (“Pass” Rate) ,[object Object],No real difference….

Need spectacular contrasts ,[object Object]

Because these are — ”samples” ,[object Object],No real difference….

Better: compare with “population” ,[object Object],A real difference….

What’s the best we can say? ,[object Object],Using what criteria? 80%? 90%….

If high stakes: U need larger “N” ,[object Object],Your benchmark: 85% will succeed on task…

ROI = “profit only if usable by at least 85% of people who try…”

3. Satisfaction (>80% = goal) ,[object Object],116/129 => 90 th Percentile scores of 81.2+ = 90 th Percentile

3. Satisfaction (goal: >80%) ,[object Object]

3. Satisfaction (>80% = goal) ,[object Object]

Final Report: Satisfaction ,[object Object],[object Object]

Final Report: Success Rate ,[object Object],[object Object],[object Object],http://www.measuringusability.com/onep.php

UT Results in Business Terms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What's hot

Prototyping and Usability Testing your designsElizabeth Snowdon

Strategies to improve effectiveness of Test automation & ROIBugRaptors

How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely

Overcoming 5 common performance testing mistakesTestingXperts

Testing Big vs. Testing Small - How To Evolve a Product Rapidly Without Sacri...VWO

Enabling CD in Enterprises with Testing - Anand BagmarThoughtworks

How to Run a Cost-Efficient Optimization Program With a Limited BudgetVWO

Influence of emphasized automation in ciBugRaptors

The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...Optimizely

VWO Webinar: How To Plan Your Optimisation RoadmapVWO

How to Build a Proof of Concept Michael Hamilton

VWO Webinar: Scaling Your Testing ProgramVWO

How to adopt construction technology in 6 steps Herbert Timpson

Challenges with agile testing process and how to debug and troubleshoot these...Chandan Patary

Tackling Strategic Engineering ChallengesApplause

What does automation mean to youAshwinee Kalkura

Delivering Excellent Digital Quality to Your CustomersApplause

Comparison of automation and manual testing pixel values technolabsPixel Values Technolabs

Pearson_Psych_Assessment_Platform_Marion_BuchenauMarion Buchenau

Boost Your Intelligent Assistants with UX TestingApplause

What's hot (20)

Prototyping and Usability Testing your designs

Strategies to improve effectiveness of Test automation & ROI

How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...

Overcoming 5 common performance testing mistakes

Testing Big vs. Testing Small - How To Evolve a Product Rapidly Without Sacri...

Enabling CD in Enterprises with Testing - Anand Bagmar

How to Run a Cost-Efficient Optimization Program With a Limited Budget

Influence of emphasized automation in ci

The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...

VWO Webinar: How To Plan Your Optimisation Roadmap

How to Build a Proof of Concept

VWO Webinar: Scaling Your Testing Program

How to adopt construction technology in 6 steps

Challenges with agile testing process and how to debug and troubleshoot these...

Tackling Strategic Engineering Challenges

What does automation mean to you

Delivering Excellent Digital Quality to Your Customers

Comparison of automation and manual testing pixel values technolabs

Pearson_Psych_Assessment_Platform_Marion_Buchenau

Boost Your Intelligent Assistants with UX Testing

Viewers also liked

Mobile PersuasionKath Straub

Webmanager University New Media Talks: User Centered DesignKath Straub

Hfi Federal Web Manager Conf08Kath Straub

HFI Presentation | Evolving eGOV: Effective uses of Web2.o @FSIS-USDAKath Straub

Crawford Upa09 Consumer Health Information SeekingKath Straub

Institutionalizing California State GovernmentKath Straub

John Sorflaten Usability ResumeJohn Sorflaten, PhD, CUXP

Reading between the words: Improving the readability and memorability of textKath Straub

Online Communities Creating Change - HomeEnergyPros (Poster presented at ACEEE)Kath Straub

Reading Beyondthe Words Using text formatting to increase persuasiveness and ...Kath Straub

UPA Arizona Presentation: Designing web content to engage customers and incre...Kath Straub

(Presentation) How to support the Plain Regulations Act (HR 1557 S 807)Kath Straub

Information design and the psychology of behavioral changeKath Straub

232 million people can't be wrong Or: How I learned to stop worrying and star...Kath Straub

Watching the edges blur: Rethinking the user experience in the world of self-...Kath Straub

Applying the science of reading to improve readability, comprehension and dir...Kath Straub

PLAIN 2013 - Is it really plain? A case (and process) for content testingKath Straub

Not your father's analytics report Mahaffey & Straub, UPA 2011 AtlantaKath Straub

Creating effective web content in plain languageKath Straub

2 Studies UX types should know about (Straub UXPA unconference13)Kath Straub

Viewers also liked (20)

Mobile Persuasion

Webmanager University New Media Talks: User Centered Design

Hfi Federal Web Manager Conf08

HFI Presentation | Evolving eGOV: Effective uses of Web2.o @FSIS-USDA

Crawford Upa09 Consumer Health Information Seeking

Institutionalizing California State Government

John Sorflaten Usability Resume

Reading between the words: Improving the readability and memorability of text

Online Communities Creating Change - HomeEnergyPros (Poster presented at ACEEE)

Reading Beyondthe Words Using text formatting to increase persuasiveness and ...

UPA Arizona Presentation: Designing web content to engage customers and incre...

(Presentation) How to support the Plain Regulations Act (HR 1557 S 807)

Information design and the psychology of behavioral change

232 million people can't be wrong Or: How I learned to stop worrying and star...

Watching the edges blur: Rethinking the user experience in the world of self-...

Applying the science of reading to improve readability, comprehension and dir...

PLAIN 2013 - Is it really plain? A case (and process) for content testing

Not your father's analytics report Mahaffey & Straub, UPA 2011 Atlanta

Creating effective web content in plain language

2 Studies UX types should know about (Straub UXPA unconference13)

Similar to Getting Roi Numbers From Ut Des Moines10 Sept09

UX Lead Product ManagementJohn Wyatt

Data-Driven Product Management by Shutterfly Director of ProductProduct School

Intuit - How to Scale Your Experimentation ProgramOptimizely

Creating Your Dashboard & Universal Measures with Userzoom – The Deep-Dive Ho...UserZoom

Driving Agile Product Development with ExperimentationSplit Software

Productivity related Vital Measures through simulationsSameer Kumar

Professional Performance Metrics | A Framework to Optimize decision Making | ...Muhammad Nizam Uddin

How to Effectively Experiment in PM by LendingTree Sr PMProduct School

Risk Driven TestingJorge Boria

Quality Process KPIs MetricsDouglas Gabel

2009 Chart Ro Ioption1pyros11

Estimate and Measure. Minimize work, maximize value. Part 2Shiftup

Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...UserZoom

The Good, The Bad, and The MetricsTeamQualityPro

REV UP 360: Rev up your ROI with Conversion Testing - Andy BattenAMA Colorado

Usability Testing - Sivaprasath SelvarajSivaprasath Selvaraj

Measuring the User Experience in Digital ProductsKaterina Maniataki

Usability in product developmentRavi Shyam

Performance evaluation toolcarlocudicinis21

PERFORMANCE EVALUATION POWERPOINTAndrew Schwartz

Similar to Getting Roi Numbers From Ut Des Moines10 Sept09 (20)

UX Lead Product Management

Data-Driven Product Management by Shutterfly Director of Product

Intuit - How to Scale Your Experimentation Program

Creating Your Dashboard & Universal Measures with Userzoom – The Deep-Dive Ho...

Driving Agile Product Development with Experimentation

Productivity related Vital Measures through simulations

Professional Performance Metrics | A Framework to Optimize decision Making | ...

How to Effectively Experiment in PM by LendingTree Sr PM

Risk Driven Testing

Quality Process KPIs Metrics

2009 Chart Ro Ioption1

Estimate and Measure. Minimize work, maximize value. Part 2

Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...

The Good, The Bad, and The Metrics

REV UP 360: Rev up your ROI with Conversion Testing - Andy Batten

Usability Testing - Sivaprasath Selvaraj

Measuring the User Experience in Digital Products

Usability in product development

Performance evaluation tool

PERFORMANCE EVALUATION POWERPOINT