Crowdtesting uses crowdsourcing to test software applications by tapping into a global community of skilled professionals. It provides benefits like complementing in-house testing resources in a cost-effective way, enabling testing on multiple devices and platforms, and gaining diverse feedback. Service providers specialize in crowdtesting methodologies and can help companies implement crowdtesting for their applications and systems.

1. Ewald Roodenrijs
Worldwide Testing: Join the Crowd

2. Program
— What is crowdtesting?
— What are the benefits of crowdtesting?
— What can crowdtesting do?
— Options for service providers
— How to implement for crowdtesting?

3. Remarkable things
Technology changed the world
— Borders have disappeared
— Everyone is connected to one other
— Interaction takes place in different ways
The world has changed with internet, but
software testing hasn’t changed that much...
Now problems with the testing of
— Multiple devices
— Third party updates
— Getting specialists
— Languages

4. Crowdsourcing + testing = Crowdtesting

5. What is crowdtesting?
— Use of crowdsourcing on testing
— New phenomenon
— Substitute to traditional testing
— Focus on acceptance
The use of an (un)known crowd of
people and knowledge when testing
software applications or systems
‘
’

6. Key benefits

7. Build a crowd
Knowledge/Performance
— Specialty (security, usability, ...)
— Beginner vs. Expert
— Novice vs. User
Background
Language
Independent blood
Mirror real world

8. The crowd can help us
— Crowdtesting can
complement in-house
resources at a practical,
tactical level
— Crowdtesting enables to
tap into the creativity and
diversity of a global
community of skilled
professionals

9. Reasons for crowdtesting

10. Applications
Lots of feedback
No sensitive data or functionality
Multi-platform software
Large end-to-end systems
Games
Beta software
Load & performance testing
Mobile software

11. Control the crowd

12. Costs control
No long term contracts
— Add or reduce resources when needed
— No initial investment

13. What makes test service providers special
— Companies have their own test methodologies
— Companies know their clients and the requirements they have for
testing
— Companies have test experts that know everything about the
right test strategy and test coverage
— Companies have years of experience

14. Opportunities service provider

15. Shopping list
A crowd
Crowd build-up
— Experts
— Novice
— Specialists
— (Potential) users
Portion software
Questionairre
Testing environment

16. Examples

17. Conclusion