We Make Mobile  Better World’s Largest Mobile Testing  and Market Research Community © 2008, 2009, 2010 Mob4Hire Inc. All rights reserved. Unauthorized duplication is prohibited.
50,000+ mobile users in 152 countries help 1,700 companies to: Understand how to  position their mobile strategy  relative to their brand Perform  functional and usability testing  of mobile apps & websites Maximize handset, carrier and country coverage;  scale test cycles Access a targeted mobile workforce   over  the carriers’ walled gardens  Launch much  better quality apps  and websites Increase mobile user engagement and  make more money
The Problem for Mobile App / Web Developers 89% of users experience application crashes. Bad Software = No Downloads = No Revenue “But … how can we create a great user experience?” Mobile users  need to see at least 4 stars  before they’ll download / purchase. Understanding customers lets you create persistent and viral mobile experiences
 
Ste Step 1   Register and start a project Step 2   Select handset, carrier & country combo’s  Step 3   Testers download, run app and  perform test script; can involve roaming and tasks plus functional and usability testing Step 4   MOB STAR  Rating;  testers complete Impact /  Performance survey Step 5   Testers get paid, results gathered, analyzed & reported
MOBEXPERIENCE CASE STUDY Partial results from Retail iPhone App study conducted Sept/Oct 2010
Where to begin improvements MobExperience points out where developers should focus; verbatims (i.e. user comments) from study give further detail on what needs to be improved. To improve MobStar Rating, you may consider focusing on following areas: Able to perform functions with precision App met my expectations. App responded quickly to my commands.
Usability Progress 1  MobStar Ratings based on users’ overall rating of the mobile app using a 5-star scale. 2  Loyalty ratings can range from 0 (low loyalty) to 10 (high loyalty). With user feedback, app got better <Developer> uses feedback from MobExperience project to improve Version 1 of mobile App and releases Version 2. Results from follow-up MobExperience project shows that Version 2 of mobile App received higher MobStar and customer loyalty ratings.
Outcomes in App Store after release Test Sept/Oct; Submitted Oct 13. Live Oct 26. SUCCESS!! Apple  accepted  app on first try submission to app store. Avg User Rating = 4+ “ Who knew it would be ____ that would jump to the front of the line in retail app development?  Highly recommended!”
HOW WE DO IT An Overview Of The Usability Science Behind MobExperience
MobExperience Overview Users install app or use mobile website Users complete survey with two main sections that are correlated: IMPACT MobStar Rating : tells you what app store rating you can expect, correlated with: 3 Dimensions of Revenue Growth and User Loyalty Ratings ( RAP ID) : will your customers recommend and buy more mobile apps from you? PERFORMANCE User Experience Software Dimensions : Overall, Stability, Application Launch, User Interface Requirement, Language, Usability, Connectivity Outcomes of the usability study: DEVELOPMENT : Where do you need to improve the customer experience to increase user loyalty and downloads? Is App ready for release? Will it be approved by the app store?  MARKETING : What resonates with users that you can focus on for marketing messages? What star rating will  you get when App is released?
Assess  customer loyalty – positive customer behaviors that help grow your brand Measures  Retention, Advocacy and Purchasing loyalty to accelerate growth 1, 2 Will users continue using app, tell their friends about the app (give it a high 4 or 5 star rating)  and download more apps from you? Measures  MobStar Rating; MobStar Certification is a 4 or 5 star app. 1 Based on research by Bob E. Hayes, Ph.D. at  Business Over Broadway 2 Example use “The Impact of Mobile User Experience on Network Operator Customer Loyalty” research  http://www.mob4hire.com/services/global-mobile-research IMPACT RAP ID Loyalty Metrics tells us “what’s important” to users
PERFORMANCE  Measuring software attributes tells us “how are we doing?” User Experience Software Dimension # of Attributes Definition Overall 2 App meets expectations and does what it is designed to do Stability 4 App behaves consistently across use and does not interfere with other smart phone functions (besides voice) Application Launch 3 App installs easily and opens immediately and consistently User Interface Requirement 5 App is easy to use; graphics, output and menu is easy to understand Language 2 App’s grammar and spelling are correct; if translated, the language used is appropriate and natural Usability 7 Can perform functions with precision; App responds quickly; Inputting information is easy Connectivity 2 App does not interfere with phone calls; works well with limited wireless connectivity Developer Specified Up to 5 Up to 5 developer questions with basic market research or direct reference to specific functionality in mobile app / website
Driver Matrix Helps Prioritize Investments Correlating “Impact” vs. “Performance” Driver Matrix helps us understand user experience attributes Key Drivers  – Fix and improve these product attributes. Hidden Drivers  – Focus on these features in marketing to grow customer base. Visible Drivers  – Consider features in marketing to grow customer base. Weak Drivers  – Disregard as priority for investment.
Seriously. You can Trust in the Mob. Partners Awards Customers
Join the Quality Revolution Contact info@mob4hire.com For a quote and a sample case study which shows a detailed look at the process and usability science behind MobExperience. [email_address]   www.mob4hire.com   www.mob4hire.blogspot.com www.twitter.com/mob4hire

Mobile Usability Overview

  • 1.
    We Make Mobile Better World’s Largest Mobile Testing and Market Research Community © 2008, 2009, 2010 Mob4Hire Inc. All rights reserved. Unauthorized duplication is prohibited.
  • 2.
    50,000+ mobile usersin 152 countries help 1,700 companies to: Understand how to position their mobile strategy relative to their brand Perform functional and usability testing of mobile apps & websites Maximize handset, carrier and country coverage; scale test cycles Access a targeted mobile workforce over the carriers’ walled gardens Launch much better quality apps and websites Increase mobile user engagement and make more money
  • 3.
    The Problem forMobile App / Web Developers 89% of users experience application crashes. Bad Software = No Downloads = No Revenue “But … how can we create a great user experience?” Mobile users need to see at least 4 stars before they’ll download / purchase. Understanding customers lets you create persistent and viral mobile experiences
  • 4.
  • 5.
    Ste Step 1 Register and start a project Step 2 Select handset, carrier & country combo’s Step 3 Testers download, run app and perform test script; can involve roaming and tasks plus functional and usability testing Step 4 MOB STAR Rating; testers complete Impact / Performance survey Step 5 Testers get paid, results gathered, analyzed & reported
  • 6.
    MOBEXPERIENCE CASE STUDYPartial results from Retail iPhone App study conducted Sept/Oct 2010
  • 7.
    Where to beginimprovements MobExperience points out where developers should focus; verbatims (i.e. user comments) from study give further detail on what needs to be improved. To improve MobStar Rating, you may consider focusing on following areas: Able to perform functions with precision App met my expectations. App responded quickly to my commands.
  • 8.
    Usability Progress 1 MobStar Ratings based on users’ overall rating of the mobile app using a 5-star scale. 2 Loyalty ratings can range from 0 (low loyalty) to 10 (high loyalty). With user feedback, app got better <Developer> uses feedback from MobExperience project to improve Version 1 of mobile App and releases Version 2. Results from follow-up MobExperience project shows that Version 2 of mobile App received higher MobStar and customer loyalty ratings.
  • 9.
    Outcomes in AppStore after release Test Sept/Oct; Submitted Oct 13. Live Oct 26. SUCCESS!! Apple accepted app on first try submission to app store. Avg User Rating = 4+ “ Who knew it would be ____ that would jump to the front of the line in retail app development? Highly recommended!”
  • 10.
    HOW WE DOIT An Overview Of The Usability Science Behind MobExperience
  • 11.
    MobExperience Overview Usersinstall app or use mobile website Users complete survey with two main sections that are correlated: IMPACT MobStar Rating : tells you what app store rating you can expect, correlated with: 3 Dimensions of Revenue Growth and User Loyalty Ratings ( RAP ID) : will your customers recommend and buy more mobile apps from you? PERFORMANCE User Experience Software Dimensions : Overall, Stability, Application Launch, User Interface Requirement, Language, Usability, Connectivity Outcomes of the usability study: DEVELOPMENT : Where do you need to improve the customer experience to increase user loyalty and downloads? Is App ready for release? Will it be approved by the app store? MARKETING : What resonates with users that you can focus on for marketing messages? What star rating will you get when App is released?
  • 12.
    Assess customerloyalty – positive customer behaviors that help grow your brand Measures Retention, Advocacy and Purchasing loyalty to accelerate growth 1, 2 Will users continue using app, tell their friends about the app (give it a high 4 or 5 star rating) and download more apps from you? Measures MobStar Rating; MobStar Certification is a 4 or 5 star app. 1 Based on research by Bob E. Hayes, Ph.D. at Business Over Broadway 2 Example use “The Impact of Mobile User Experience on Network Operator Customer Loyalty” research http://www.mob4hire.com/services/global-mobile-research IMPACT RAP ID Loyalty Metrics tells us “what’s important” to users
  • 13.
    PERFORMANCE Measuringsoftware attributes tells us “how are we doing?” User Experience Software Dimension # of Attributes Definition Overall 2 App meets expectations and does what it is designed to do Stability 4 App behaves consistently across use and does not interfere with other smart phone functions (besides voice) Application Launch 3 App installs easily and opens immediately and consistently User Interface Requirement 5 App is easy to use; graphics, output and menu is easy to understand Language 2 App’s grammar and spelling are correct; if translated, the language used is appropriate and natural Usability 7 Can perform functions with precision; App responds quickly; Inputting information is easy Connectivity 2 App does not interfere with phone calls; works well with limited wireless connectivity Developer Specified Up to 5 Up to 5 developer questions with basic market research or direct reference to specific functionality in mobile app / website
  • 14.
    Driver Matrix HelpsPrioritize Investments Correlating “Impact” vs. “Performance” Driver Matrix helps us understand user experience attributes Key Drivers – Fix and improve these product attributes. Hidden Drivers – Focus on these features in marketing to grow customer base. Visible Drivers – Consider features in marketing to grow customer base. Weak Drivers – Disregard as priority for investment.
  • 15.
    Seriously. You canTrust in the Mob. Partners Awards Customers
  • 16.
    Join the QualityRevolution Contact info@mob4hire.com For a quote and a sample case study which shows a detailed look at the process and usability science behind MobExperience. [email_address] www.mob4hire.com www.mob4hire.blogspot.com www.twitter.com/mob4hire

Editor's Notes

  • #3 Adidas needed testing of it’s iPhone app “MyCoach” … location based testing is a challenge for many developers. MyCoach is available now on the iPhone App Store.
  • #4 $80MM total opp with 1MM mobile developers. These tests have utilized the best part of the “mob” … the people. These require location, mobility, different carriers, manually checking voice quality, etc… they cannot be automated because there needs to be a person at the other end of the developers phone.
  • #5 $80MM total opp with 1MM mobile developers. These tests have utilized the best part of the “mob” … the people. These require location, mobility, different carriers, manually checking voice quality, etc… they cannot be automated because there needs to be a person at the other end of the developers phone.
  • #16 Telecom / handset firms have “Developer Network” divisions to help 3 rd party mobile developers create software for their platform Partner engagements facilitate low-cost developer acquisition into Mob4Hire community.