Dieter Speidel, Pass Group. Presented at Crowdsourcing Week Summit Geneva. For more information or to join the next event: http://crowdsourcingweek.com/

1. 1
Crowdtesting 2.0
From Anonymous Crowd to Target Audience & Customer Community

2. 2
About PASS Group
Global Delivery
Industry Coverage
• Mobile, Web & Destop Apps
• Wearables
• Mobile Health Devices
• IoT Devices
• Gaming Consoles
• Set Top Boxes
• Automotive IT
Product & Application Types
• 25 years in Quality Assurance
• Thought Leader + Leading Provider of Crowdsourcing &
Community Engagement Solutions for Digital Assurance
under the brand name passbrains since 2011
• Specialized in building public and private crowdsource
communities and user groups for digital product
innovation, testing and continuous quality improvement
• Delivery Model: SaaS, Managed Service
Sales Representations:
Germany
Austria
France
Italy
Spain
Netherlands
United Kingdom
Israel
U.S.A.
PASS Subsidiaries:
Switzerland
Germany
India
Serbia
• Technology & Hi Tech
• Retail & E-Commerce
• Travel & Hospitality
• Media & Entertainment
• Education & eLearning
• Financial Services
• Healthcare & Life Sciences

3. 3
Crowdsourced
Digital
Assurance
Insights
Ideation
Evaluation
Usability Studies
Testing
Content Validation
User Experience
Continuous
Improvement
Support
Crowdsourced model for open innovation, evaluation and testing of devices,
apps and websites, using cloud-based tools or platform solutions
Definition

4. 4
Enterprise Workforce
Outsourced Skills &
Capacities
Public Crowds
Private Crowds
Crowdsourcing leverages your Digital Assurance
Programs

5. … by engaging Public & Private Crowds
5
• Subject matter experts
• Good for deeper analytics on
improvement potentials
• Global coverage on-demand
• Professional motivation
• Neutral view
• Enterprise identification
• Product knowledge
• Utilization of excess capacity
• Reflect market
requirements
• Provide relevant UX
• Appreciate participating
• Brand identification

6. 6
… for your Apps & Digital Products

7. … and the Internet of Things
7

8. Who qualifies for Crowdsourced Digital
Assurance?
8
Users+
Customers
Professional
Testers
Employees &
Contractors
Subject Matter
Experts

9. Principle of Crowdsourced Engagement
9
Thousands of
community members
available
Members competing
and delivering
immediate results
Selecting the right
ones based on
profile
Attractive bounties &
rewards offerings
• Demographics
• Skills
• Domain Background
• Devices, Configurations
• Performance Track
Record

10. Deliverables – Issue Reports + Improvement
Suggestions
10

11. Deliverables – Instructions + Structured Test
Cases
11

12. Deliverables – User Experience Surveys
12

13. Deliverables – Narrated UX Video-Recordings
13

14. Deliverables – Audience / Contributor
Segmentation
14

15. 15

16. Deliverables: Analytics (e.g. CSAT)
16

17. Deliverables: Analytics (e.g. Ticket Types)
17

18. Deliverables: Analytics (e.g. Device Coverage)
18

19. Passbrains – the leading Digital Assurance
Platform
19

20. Open Invitation for Web Shop Test: (UX+FN)
0
100
200
300
400
500
600
Total Active Testers
Total Tickets
20

21. Continous Post-Release Test Online Auction
(UX+FN)
Effort Details
• 16 Weeks Duration, Biweekly Updates
• 8 Test Cycles
• 88 Crowd Testers + 5 Crowd Champions
• 1 Internal Test Managers
• 3 Reviewers
Technology Coverage
• OS: Linux, Mac, Windows (incl. Win8 beta)
• Browsers: IE7 to 10, Firefox, Chrome, Safari
Regional Coverage
• 26 Countries
• 5 Languages
Platform
21
 56% total cost reduction achieved
 33% reduction of test cycle time
 2748 tickets logged with > 70% acceptance
 150+ new features & enhancement requests accepted by client
Key Highlights

22. Case Study: upc cablecom Customer Crowd
22

23. Benefits of Crowdsourced Digital Assurance
23
Product- & Service
Excellence
Improved product usability
and quality => maximized
customer satisfaction
On-Demand Cost-effective
Scalable Fast
Lead times of hours/ days
instead of weeks
1000x contributors
50%-70% lower costs
Quick Turnaround

24. PASS Group
Zürich  Hamburg  Boston  Belgrade  Bangalore
www.pass.ch
www.passbrains.com
24