Better Apps With Crowdsourcing & The Cloud Skytap and uTest Present: Ian Knox [email_address] Cloudcastblog.com Stanton Champion [email_address] uTest.com

Session Objectives Discuss how crowdsourcing and cloud computing can be used together to improve the application delivery process Examples of how leading companies are using crowdsourcing and cloud computing to achieve their goals Best practices for using these solutions to launch higher quality apps and control costs

Discuss how crowdsourcing and cloud computing can be used together to improve the application delivery process

Examples of how leading companies are using crowdsourcing and cloud computing to achieve their goals

Best practices for using these solutions to launch higher quality apps and control costs

The Cloud Computing Power When You Need It On demand Extremely scalable Accessible from anywhere over the Web Pay only for what you need Cloud Service Examples: Skytap Virtual Lab Amazon EC2 Microsoft Azure

The Cloud

Computing Power When You Need It

On demand

Extremely scalable

Accessible from anywhere over the Web

Pay only for what you need

Cloud Service Examples:

Skytap Virtual Lab

Amazon EC2

Microsoft Azure

The Crowd People Empowered by the Network Total of individual contributions greater than the sum of the parts Pay for only what you use Real-World, Real-Time Crowdsourcing Examples: uTest Digg Innocentive TekScout

The Crowd

People Empowered by the Network

Total of individual contributions greater than the sum of the parts

Pay for only what you use

Real-World, Real-Time

Crowdsourcing Examples:

uTest

Digg

Innocentive

TekScout

Implications for Application Development Customer Interaction Rapid prototyping / feedback Frequent UAT cycles Agile Development Self-service virtual infrastructure Collaborative workspaces Scalable, On Demand Teams Global feedback / testing Resource scaling Architecture / Design Build Stabilize Deploy

Customer Interaction

Rapid prototyping / feedback

Frequent UAT cycles

Agile Development

Self-service virtual infrastructure

Collaborative workspaces

Scalable, On Demand Teams

Global feedback / testing

Resource scaling

How It Works: Collaborative, Cloud-Based Testing C(2) C(1) A B C Configuration Library Virtual Infrastructure Virtual Lab Management Application uTest Testers Kate (Developer) Matt (Customer)

Faster iterations, less friction Richer test matrices / coverage Defects resolved more quickly Lower overall project costs The Result: Better Applications, Delivered Faster

Faster iterations, less friction

Richer test matrices / coverage

Defects resolved more quickly

Lower overall project costs

DEMO

Challenge: Needed an extensive test lab for a new migration application 15 global users including 9 testers in Bangalore, India ~ $250K capital cost to build adequate lab Customer Benefits: Deferred CapEx; 50% savings compared to internal lab Defect resolution time reduced 75% by global workflow collaboration Deferred hiring 1-2 FTE for IT operations Solution Access to Skytap Virtual Lab in 24 hrs Generated over 13 TBs of snapshot images during testing Scaled down usage between test iterations Example: Kivati

Challenge:

Needed an extensive test lab for a new migration application

15 global users including 9 testers in Bangalore, India

~ $250K capital cost to build adequate lab

Customer Benefits:

Deferred CapEx; 50% savings compared to internal lab

Defect resolution time reduced 75% by global workflow collaboration

Deferred hiring 1-2 FTE for IT operations

Solution

Access to Skytap Virtual Lab in 24 hrs

Generated over 13 TBs of snapshot images during testing

Scaled down usage between test iterations

Challenge: Wanted quality feedback that represented “real customers” Agile development model with three week sprints Customer Benefits: No longer had non-development staff doing testing Substantial reduction in customer-facing bugs with each release Reduced costs while keeping an aggressive agile schedule Solution Use uTest to gather professional testers like their customers for real-world testing Testers fit perfectly within their agile process Able to find average of 40-50 bugs within each release Example: Second Rotation

Challenge:

Wanted quality feedback that represented “real customers”

Agile development model with three week sprints

Customer Benefits:

No longer had non-development staff doing testing

Substantial reduction in customer-facing bugs with each release

Reduced costs while keeping an aggressive agile schedule

Solution

Use uTest to gather professional testers like their customers for real-world testing

Testers fit perfectly within their agile process

Able to find average of 40-50 bugs within each release

Get started with a well-defined pilot project Beware of the ‘sunk cost’ fallacy! It’s not an either/or decision Consider crowdsourcing for ‘wide net’ testing Understand organizational implications 5 Recommendations for Success

Get started with a well-defined pilot project

Beware of the ‘sunk cost’ fallacy!

It’s not an either/or decision

Consider crowdsourcing for ‘wide net’ testing

Understand organizational implications

More Information Ian Knox [email_address] Cloudcastblog.com Stanton Champion [email_address] uTest.com Additional Reading: CrowdsourcingLinks - http://www.crowdsourcinglinks.com/ Wikipedia- http://en.wikipedia.org/wiki/Cloud_computing Follow-Up Email: Webinar recording online 2 white papers: ‘Building a Truly Virtual QA Lab’ and

Additional Reading:

CrowdsourcingLinks - http://www.crowdsourcinglinks.com/

Wikipedia- http://en.wikipedia.org/wiki/Cloud_computing

Follow-Up Email:

Webinar recording online

2 white papers: ‘Building a Truly Virtual QA Lab’ and