The Power of the Crowd: Mobile Testing for Scale and Global Coverage


Published on

John Carpenter, CTO, Mob4Hire, illuminates the audience at Starwest with his look at how the crowd can perform scaling and global coverage miracles when it comes to the difficult but absolutely necessary of performing mobile user feedback studies BEFORE you launch your mobile app or website.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Introduction.Development backgroundPassion around development. Agenda, why, when and how to do testing.
  • Glu and EA mobile
  • Tighter budget, lower timeline, higher expectation
  • Tighter budget, lower timeline, higher expectation
  • We can predict 4 and 5 star apps, and we can also analyze user feedback to see how you need to improve the app.$100M opp with 1,000,000 developersWe see a lot of mobile brands doing MobTest … alsoMobTasks, like GCI and SIM Roaming testingWe’re seeing a lot of Big Brands doing usability testing … MobExperience … trying to ensure and understand how they are positioning (and how they can position) in marketplace
  • The Power of the Crowd: Mobile Testing for Scale and Global Coverage

    1. 1. The Power Of The Crowd<br />Mobile Testing for Scale and Global Coverage<br />Sept 30, 2010<br />John Carpenter PEng, CTO<br /><br />
    2. 2. “Trism has made $250,000 for its developer, Steve Demeter, in just two month”1<br />“5 out of 6 app developers will not break even”2<br />“Joel Comm, whose virtual flatulence app, iFart, was at one point earning him £5,000 every day”3<br />“[Only] one in 8 - will break even its programming costs in six months of downloads” 2<br />Wired Magazine.<br />3. Telegraph UK.<br />2. TomiAhonen<br />
    3. 3. Would you buy it?<br />
    4. 4. Don’t Suck– <br />How do Users Respond to Your App? <br />Get Sticky– <br />User Feedback / Customer <br />Loyalty Starts Here? <br />What Features Will Go In <br />The Next Version <br />Don’t Crash – <br />Do Your Unit Testing. White Box Testing. <br />
    5. 5. 7 years ago developing a mobile application,<br /> deploy on 3 carriers for around 3% of phones<br /> [Blister] says that they are the first location based fishing game, which we're sure is true, since we're not even sure there is a market for one of these things.1<br />took a team of 15, 6 months and cost ~$500,000 <br />Engadget .<br />
    6. 6. Today,<br />$30,000 and take less than 6 weeks..<br />Android Lib Stats.<br />...expectations are higher. Budgets are lower.<br />
    7. 7. Today,<br />User Feedback is Even More Important<br />..69% of users discovery apps through rankings, reviews and recommendation<br />
    8. 8. The Crowd Are Amateurs<br />The Crowd are Your Customers<br />
    9. 9. FLIRT model for planning open collaboration<br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    10. 10. What do you need done?<br />What results are you looking for? In what format? <br />What is the objective of engaging the community? <br />Who is managing it? <br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    11. 11. Does the Tester Understand the Tasks? <br />Is There a Mutual Understanding and Respect?<br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    12. 12. Is There a Reasonable Incentive to Complete The Task?<br />Are There Reasonable Safe Guards Against Unknowns?<br />What Non-Monetary Value Can You Offer?<br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    13. 13. Are You Protecting Your IP? Copyright Issues?<br />What Is The Criteria For Completion?<br />What Constraints on Testing Are Needed?<br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    14. 14. Do You Have The Ability To Monitor The Work?<br />How Do You Correct Deficiencies?<br />How Do You Handle App Distribution?<br />Focus<br />Language<br />Incentives<br />Rules<br />Tools<br />Sami Viitamaki<br /><br />
    15. 15. Rule 1 Don’t Crowd Source Your Development<br />
    16. 16. Rule 2 Don’t Internal Source Your Usability Testing<br />“Thankfully, the theory behind such poor scoring isn’t an inherent bug or an outright failure to work, but users’ annoyance at not being able to access the app without stumping up the necessary £9.99-per-month premium subscription.”. T3 UK <br />
    17. 17. LIVEprojects<br /><br />1,700 developers registered in the Mob4Hire community<br />
    18. 18. Thanks!<br /><br /><br /><br /><br /><br />