SlideShare a Scribd company logo
Fundamentals of
Crowdsourced Testing
You want to release quality software
that the market and consumers want.
The problem is that the pressure to
deliver is immense.
Fundamentals of Crowdsourced Testing
48%
Of users are less likely to use an app again if they are unhappy with the app’s
performance.
Fundamentals of Crowdsourced Testing
79%
Of people are less likely to purchase from a site again if they experience performance
issues.
Fundamentals of Crowdsourced Testing
88%
Of consumers form negative opinions of brands if the brand has a poorly performing
app.
We get it. Releasing quality software is
hard. We know because we’ve been in
your shoes.
Fundamentals of Crowdsourced Testing
Agenda
● Who we are
● The old way
● The new way
● Automate all the things!
● Don’t automate all the things!
● Crowdsourced Testing
Fundamentals of Crowdsourced Testing
Some of the biggest brands in the world trust us to
guide them through the chaos.
Fundamentals of Crowdsourced Testing
Introductions
Nick Roberts, Head of Research and Marketing
Over 15 years experience in technology and SaaS markets. Previous work includes
DefenseStorm, GoDaddy, Cox Communications and more.
Bethany Ward, Senior Account Manager
Bethany is a Senior Account Manager at Global App Testing working with companies such as
Virgin Media, Quizlet, MileIQ (Microsoft) and many others to scale their QA operations.
Fundamentals of Crowdsourced Testing
The old way
● Software was built in a waterfall environment with large releases
● Developers built an application and handed it off for testing
● QA returned with results and the developers set off to fix bugs before release
Fundamentals of Crowdsourced Testing
The problems with the old way
● Development was slow and clunky
● It took forever to release your software
● Quality suffered
Fundamentals of Crowdsourced Testing
The New Way
● Small, iterative approaches to software development
○ Agile
○ DevOps
○ Continuous Development/Integration
● Much faster releases and growth
● Quality shifts-left
A problem emerges.
Fundamentals of Crowdsourced Testing
A small problem emerges
● The pressure to release an app or a website within faster development time
increases exponentially
○ Testing/QA teams are given less time to ensure bug free software is ready for release
○ Fear and uncertainty around release begins to set in
○ Poor releases risk the company's growth
● Automation is the answer!
Fundamentals of Crowdsourced Testing
Automation isn’t the only answer
● Tackles the implicit-knowns
● Requires heavy infrastructure investment and maintenance
● Doesn’t address real-world situations or examples
● It does have its place
○ Automate what you can, where you can
○ Build scenarios that improve human efficiency
Fundamentals of Crowdsourced Testing
Can’t we just hire more QA?
● Absolutely! And you should
● But, this doesn’t scale
● Isn’t flexible
● Doesn’t address localised needs
Fundamentals of Crowdsourced Testing
Let’s Use Crowdsourced Testing!
● Addresses scalability
○ On-demand, real-world professional testers
● Addresses speed
○ Delivers results in under 48 hours
● Addresses flexibility
○ Location agnostic + fragmentation free
You don’t have to sacrifice quality for speed.
Fundamentals of Crowdsourced Testing
How it works
1. You provide the test cases or plan (or we can help you write them)
2. You choose the testing type (exploratory and/or test case execution/regression
testing)
a. A crowd of professional testers gets to work on your tests
3. You receive reports in under 48 hours
4. You Fix the bugs
a. Get them verified at no extra cost
Fundamentals of Crowdsourced Testing
Testing Scaled at Speed - In just over
four weeks, Global App Testing tested
5000 apps and found critical issues in over
900 of them which could have damaged
Facebook’s reputation.
Testing localised - To date, Global
App Testing has tested in over 45 cities
around the world for LiveSafe.
LiveSafe requires testers to live and
work in each target city to capture
contextual information outside the
limitations of automated testing.
Testing Flexibility - By integrating Global
App Testing’s crowdsourced testers into their
development process, PromoFarma have
been able to decrease their cycle time from
monthly to every two weeks.
Fundamentals of Crowdsourced Testing
Who is in your crowd?
● Professional testers around the world who:
○ Do this for a living
○ Do this on the side of their professional job
○ Are retired from testing
● Meet some of them:
Fundamentals of Crowdsourced Testing
Quality of Results
● Results need to:
○ Be impactful
○ Be moderated
○ Be reproducible with clear steps
○ Be on time
○ Help improve your release processes and workflows
✓
Fundamentals of Crowdsourced Testing
Can I do this myself?
Isn’t this just beta testing?
Build your own crowd!
Fundamentals of Crowdsourced Testing
How to get started
1. Request a consultation
2. Pick a plan
3. Onboard
4. Start testing
Fundamentals of Crowdsourced Testing
Questions?
nick@globalapptesting.com / beth@globalapptesting.com

More Related Content

What's hot

[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
Ho Chi Minh City Software Testing Club
 
Transitioning To Agile
Transitioning To Agile Transitioning To Agile
Transitioning To Agile
ThoughtWorks Studios
 
Streamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data ManagementStreamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data Management
QASymphony
 
Exploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony WebinarExploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony Webinar
QASymphony
 
Testing Metrics and why Managers like them
Testing Metrics and why Managers like themTesting Metrics and why Managers like them
Testing Metrics and why Managers like them
PractiTest
 
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
Ho Chi Minh City Software Testing Club
 
Communication skills for testers
Communication skills for testersCommunication skills for testers
Communication skills for testers
PractiTest
 
Test beyond the obvious- Root Cause Analysis
Test beyond the obvious- Root Cause AnalysisTest beyond the obvious- Root Cause Analysis
Test beyond the obvious- Root Cause Analysis
PractiTest
 
Dallas Techologies
Dallas TechologiesDallas Techologies
Dallas Techologies
DallasTechnologies
 
[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great
Ho Chi Minh City Software Testing Club
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing Methods
Reuben Korngold
 
Risk management at warp speed
Risk management at warp speedRisk management at warp speed
Risk management at warp speed
Bradley Scott
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
TEST Huddle
 
Thinking Beyond HPQC ALM
Thinking Beyond HPQC ALMThinking Beyond HPQC ALM
Thinking Beyond HPQC ALM
QASymphony
 
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
Ho Chi Minh City Software Testing Club
 
Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011
TEST Huddle
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
Ho Chi Minh City Software Testing Club
 
Stc chandan patary_ua_testing _ stc
Stc chandan patary_ua_testing _ stcStc chandan patary_ua_testing _ stc
Stc chandan patary_ua_testing _ stc
Chandan Patary
 
From Defect Reporting To Defect Prevention
From Defect Reporting To Defect PreventionFrom Defect Reporting To Defect Prevention
From Defect Reporting To Defect Prevention
Sune Gynthersen
 
Fundamentals of Risk-based Testing
Fundamentals of Risk-based TestingFundamentals of Risk-based Testing
Fundamentals of Risk-based Testing
TechWell
 

What's hot (20)

[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
[HCMC STC Jan 2015] How To Work Effectively As a Tester in Agile Teams
 
Transitioning To Agile
Transitioning To Agile Transitioning To Agile
Transitioning To Agile
 
Streamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data ManagementStreamlining Automation Scripts and Test Data Management
Streamlining Automation Scripts and Test Data Management
 
Exploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony WebinarExploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony Webinar
 
Testing Metrics and why Managers like them
Testing Metrics and why Managers like themTesting Metrics and why Managers like them
Testing Metrics and why Managers like them
 
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
[HCMC STC Jan 2015] Workshop Of Context-Driven Testing In Agile
 
Communication skills for testers
Communication skills for testersCommunication skills for testers
Communication skills for testers
 
Test beyond the obvious- Root Cause Analysis
Test beyond the obvious- Root Cause AnalysisTest beyond the obvious- Root Cause Analysis
Test beyond the obvious- Root Cause Analysis
 
Dallas Techologies
Dallas TechologiesDallas Techologies
Dallas Techologies
 
[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great[Mush Honda] Software Testers From Good to Great
[Mush Honda] Software Testers From Good to Great
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing Methods
 
Risk management at warp speed
Risk management at warp speedRisk management at warp speed
Risk management at warp speed
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
 
Thinking Beyond HPQC ALM
Thinking Beyond HPQC ALMThinking Beyond HPQC ALM
Thinking Beyond HPQC ALM
 
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
 
Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011Isabel Evans - Quality In Use - EuroSTAR 2011
Isabel Evans - Quality In Use - EuroSTAR 2011
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
 
Stc chandan patary_ua_testing _ stc
Stc chandan patary_ua_testing _ stcStc chandan patary_ua_testing _ stc
Stc chandan patary_ua_testing _ stc
 
From Defect Reporting To Defect Prevention
From Defect Reporting To Defect PreventionFrom Defect Reporting To Defect Prevention
From Defect Reporting To Defect Prevention
 
Fundamentals of Risk-based Testing
Fundamentals of Risk-based TestingFundamentals of Risk-based Testing
Fundamentals of Risk-based Testing
 

Similar to Fundamentals of crowdsourced testing

How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
DiUS
 
Improving software quality for the future of connected vehicles
Improving software quality for the future of connected vehiclesImproving software quality for the future of connected vehicles
Improving software quality for the future of connected vehicles
Devon Bleibtrey
 
A_Brief_Insight_on_Independent_Testing
A_Brief_Insight_on_Independent_TestingA_Brief_Insight_on_Independent_Testing
A_Brief_Insight_on_Independent_Testing
Aayush Gupta
 
Tackling software testing challenges in the agile era
Tackling software testing challenges in the agile eraTackling software testing challenges in the agile era
Tackling software testing challenges in the agile era
QASymphony
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
VWO
 
Top 10 Benefits of Crowd Testing
Top 10 Benefits of Crowd TestingTop 10 Benefits of Crowd Testing
Top 10 Benefits of Crowd Testing
KiwiQA
 
Qa focus 2015 2020
Qa focus 2015 2020Qa focus 2015 2020
Qa focus 2015 2020
anuvip
 
Most Advanced Software Testing Solution Providers of 2022.pdf
Most Advanced Software Testing Solution Providers of 2022.pdfMost Advanced Software Testing Solution Providers of 2022.pdf
Most Advanced Software Testing Solution Providers of 2022.pdf
InsightsSuccess4
 
TestPRO Profile v4.1
TestPRO Profile v4.1TestPRO Profile v4.1
TestPRO Profile v4.1
Samer Desouky
 
Agile case studies
Agile case studiesAgile case studies
Agile case studies
Sébastien Donné
 
Top Software panies to Outsource.pdfTesting Com
Top Software panies to Outsource.pdfTesting ComTop Software panies to Outsource.pdfTesting Com
Top Software panies to Outsource.pdfTesting Com
Mindfire LLC
 
Agile Development in Highly Regulated Organizations
Agile Development in Highly Regulated OrganizationsAgile Development in Highly Regulated Organizations
Agile Development in Highly Regulated Organizations
Celerity
 
Testing in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the LabTesting in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the Lab
TechWell
 
A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing Maturity
TechWell
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
Ashish Kumar
 
fireup pro software house - this is who we are
fireup pro software house - this is who we arefireup pro software house - this is who we are
fireup pro software house - this is who we are
fireup.pro
 
Tk
TkTk
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing Transition
TechWell
 
Liferay Go-Live Program
Liferay Go-Live ProgramLiferay Go-Live Program
Liferay Go-Live Program
Sharmila Wijeyakumar, CBIP
 
Test Environment Management- An Emerging Truth Of DevOps
Test Environment Management- An Emerging Truth Of DevOpsTest Environment Management- An Emerging Truth Of DevOps
Test Environment Management- An Emerging Truth Of DevOps
Enov8
 

Similar to Fundamentals of crowdsourced testing (20)

How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
 
Improving software quality for the future of connected vehicles
Improving software quality for the future of connected vehiclesImproving software quality for the future of connected vehicles
Improving software quality for the future of connected vehicles
 
A_Brief_Insight_on_Independent_Testing
A_Brief_Insight_on_Independent_TestingA_Brief_Insight_on_Independent_Testing
A_Brief_Insight_on_Independent_Testing
 
Tackling software testing challenges in the agile era
Tackling software testing challenges in the agile eraTackling software testing challenges in the agile era
Tackling software testing challenges in the agile era
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
 
Top 10 Benefits of Crowd Testing
Top 10 Benefits of Crowd TestingTop 10 Benefits of Crowd Testing
Top 10 Benefits of Crowd Testing
 
Qa focus 2015 2020
Qa focus 2015 2020Qa focus 2015 2020
Qa focus 2015 2020
 
Most Advanced Software Testing Solution Providers of 2022.pdf
Most Advanced Software Testing Solution Providers of 2022.pdfMost Advanced Software Testing Solution Providers of 2022.pdf
Most Advanced Software Testing Solution Providers of 2022.pdf
 
TestPRO Profile v4.1
TestPRO Profile v4.1TestPRO Profile v4.1
TestPRO Profile v4.1
 
Agile case studies
Agile case studiesAgile case studies
Agile case studies
 
Top Software panies to Outsource.pdfTesting Com
Top Software panies to Outsource.pdfTesting ComTop Software panies to Outsource.pdfTesting Com
Top Software panies to Outsource.pdfTesting Com
 
Agile Development in Highly Regulated Organizations
Agile Development in Highly Regulated OrganizationsAgile Development in Highly Regulated Organizations
Agile Development in Highly Regulated Organizations
 
Testing in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the LabTesting in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the Lab
 
A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing Maturity
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
 
fireup pro software house - this is who we are
fireup pro software house - this is who we arefireup pro software house - this is who we are
fireup pro software house - this is who we are
 
Tk
TkTk
Tk
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing Transition
 
Liferay Go-Live Program
Liferay Go-Live ProgramLiferay Go-Live Program
Liferay Go-Live Program
 
Test Environment Management- An Emerging Truth Of DevOps
Test Environment Management- An Emerging Truth Of DevOpsTest Environment Management- An Emerging Truth Of DevOps
Test Environment Management- An Emerging Truth Of DevOps
 

Recently uploaded

Penify - Let AI do the Documentation, you write the Code.
Penify - Let AI do the Documentation, you write the Code.Penify - Let AI do the Documentation, you write the Code.
Penify - Let AI do the Documentation, you write the Code.
KrishnaveniMohan1
 
Modelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - AmsterdamModelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - Amsterdam
Alberto Brandolini
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
kgyxske
 
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
Paul Brebner
 
14 th Edition of International conference on computer vision
14 th Edition of International conference on computer vision14 th Edition of International conference on computer vision
14 th Edition of International conference on computer vision
ShulagnaSarkar2
 
ppt on the brain chip neuralink.pptx
ppt  on   the brain  chip neuralink.pptxppt  on   the brain  chip neuralink.pptx
ppt on the brain chip neuralink.pptx
Reetu63
 
WWDC 2024 Keynote Review: For CocoaCoders Austin
WWDC 2024 Keynote Review: For CocoaCoders AustinWWDC 2024 Keynote Review: For CocoaCoders Austin
WWDC 2024 Keynote Review: For CocoaCoders Austin
Patrick Weigel
 
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
safelyiotech
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
Pedro J. Molina
 
The Rising Future of CPaaS in the Middle East 2024
The Rising Future of CPaaS in the Middle East 2024The Rising Future of CPaaS in the Middle East 2024
The Rising Future of CPaaS in the Middle East 2024
Yara Milbes
 
ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.
Maitrey Patel
 
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
gapen1
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert
vaishalijagtap12
 
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
ToXSL Technologies
 
Building API data products on top of your real-time data infrastructure
Building API data products on top of your real-time data infrastructureBuilding API data products on top of your real-time data infrastructure
Building API data products on top of your real-time data infrastructure
confluent
 
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptxOperational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
sandeepmenon62
 
The Role of DevOps in Digital Transformation.pdf
The Role of DevOps in Digital Transformation.pdfThe Role of DevOps in Digital Transformation.pdf
The Role of DevOps in Digital Transformation.pdf
mohitd6
 
Beginner's Guide to Observability@Devoxx PL 2024
Beginner's  Guide to Observability@Devoxx PL 2024Beginner's  Guide to Observability@Devoxx PL 2024
Beginner's Guide to Observability@Devoxx PL 2024
michniczscribd
 

Recently uploaded (20)

Penify - Let AI do the Documentation, you write the Code.
Penify - Let AI do the Documentation, you write the Code.Penify - Let AI do the Documentation, you write the Code.
Penify - Let AI do the Documentation, you write the Code.
 
Modelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - AmsterdamModelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - Amsterdam
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
 
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...
 
14 th Edition of International conference on computer vision
14 th Edition of International conference on computer vision14 th Edition of International conference on computer vision
14 th Edition of International conference on computer vision
 
ppt on the brain chip neuralink.pptx
ppt  on   the brain  chip neuralink.pptxppt  on   the brain  chip neuralink.pptx
ppt on the brain chip neuralink.pptx
 
WWDC 2024 Keynote Review: For CocoaCoders Austin
WWDC 2024 Keynote Review: For CocoaCoders AustinWWDC 2024 Keynote Review: For CocoaCoders Austin
WWDC 2024 Keynote Review: For CocoaCoders Austin
 
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
 
The Rising Future of CPaaS in the Middle East 2024
The Rising Future of CPaaS in the Middle East 2024The Rising Future of CPaaS in the Middle East 2024
The Rising Future of CPaaS in the Middle East 2024
 
ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.ACE - Team 24 Wrapup event at ahmedabad.
ACE - Team 24 Wrapup event at ahmedabad.
 
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert
 
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
 
Building API data products on top of your real-time data infrastructure
Building API data products on top of your real-time data infrastructureBuilding API data products on top of your real-time data infrastructure
Building API data products on top of your real-time data infrastructure
 
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptxOperational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
Operational ease MuleSoft and Salesforce Service Cloud Solution v1.0.pptx
 
The Role of DevOps in Digital Transformation.pdf
The Role of DevOps in Digital Transformation.pdfThe Role of DevOps in Digital Transformation.pdf
The Role of DevOps in Digital Transformation.pdf
 
Beginner's Guide to Observability@Devoxx PL 2024
Beginner's  Guide to Observability@Devoxx PL 2024Beginner's  Guide to Observability@Devoxx PL 2024
Beginner's Guide to Observability@Devoxx PL 2024
 

Fundamentals of crowdsourced testing

  • 2. You want to release quality software that the market and consumers want.
  • 3. The problem is that the pressure to deliver is immense.
  • 4. Fundamentals of Crowdsourced Testing 48% Of users are less likely to use an app again if they are unhappy with the app’s performance.
  • 5. Fundamentals of Crowdsourced Testing 79% Of people are less likely to purchase from a site again if they experience performance issues.
  • 6. Fundamentals of Crowdsourced Testing 88% Of consumers form negative opinions of brands if the brand has a poorly performing app.
  • 7. We get it. Releasing quality software is hard. We know because we’ve been in your shoes.
  • 8. Fundamentals of Crowdsourced Testing Agenda ● Who we are ● The old way ● The new way ● Automate all the things! ● Don’t automate all the things! ● Crowdsourced Testing
  • 9. Fundamentals of Crowdsourced Testing Some of the biggest brands in the world trust us to guide them through the chaos.
  • 10. Fundamentals of Crowdsourced Testing Introductions Nick Roberts, Head of Research and Marketing Over 15 years experience in technology and SaaS markets. Previous work includes DefenseStorm, GoDaddy, Cox Communications and more. Bethany Ward, Senior Account Manager Bethany is a Senior Account Manager at Global App Testing working with companies such as Virgin Media, Quizlet, MileIQ (Microsoft) and many others to scale their QA operations.
  • 11. Fundamentals of Crowdsourced Testing The old way ● Software was built in a waterfall environment with large releases ● Developers built an application and handed it off for testing ● QA returned with results and the developers set off to fix bugs before release
  • 12. Fundamentals of Crowdsourced Testing The problems with the old way ● Development was slow and clunky ● It took forever to release your software ● Quality suffered
  • 13. Fundamentals of Crowdsourced Testing The New Way ● Small, iterative approaches to software development ○ Agile ○ DevOps ○ Continuous Development/Integration ● Much faster releases and growth ● Quality shifts-left
  • 15. Fundamentals of Crowdsourced Testing A small problem emerges ● The pressure to release an app or a website within faster development time increases exponentially ○ Testing/QA teams are given less time to ensure bug free software is ready for release ○ Fear and uncertainty around release begins to set in ○ Poor releases risk the company's growth ● Automation is the answer!
  • 16. Fundamentals of Crowdsourced Testing Automation isn’t the only answer ● Tackles the implicit-knowns ● Requires heavy infrastructure investment and maintenance ● Doesn’t address real-world situations or examples ● It does have its place ○ Automate what you can, where you can ○ Build scenarios that improve human efficiency
  • 17. Fundamentals of Crowdsourced Testing Can’t we just hire more QA? ● Absolutely! And you should ● But, this doesn’t scale ● Isn’t flexible ● Doesn’t address localised needs
  • 18. Fundamentals of Crowdsourced Testing Let’s Use Crowdsourced Testing! ● Addresses scalability ○ On-demand, real-world professional testers ● Addresses speed ○ Delivers results in under 48 hours ● Addresses flexibility ○ Location agnostic + fragmentation free
  • 19. You don’t have to sacrifice quality for speed.
  • 20. Fundamentals of Crowdsourced Testing How it works 1. You provide the test cases or plan (or we can help you write them) 2. You choose the testing type (exploratory and/or test case execution/regression testing) a. A crowd of professional testers gets to work on your tests 3. You receive reports in under 48 hours 4. You Fix the bugs a. Get them verified at no extra cost
  • 21. Fundamentals of Crowdsourced Testing Testing Scaled at Speed - In just over four weeks, Global App Testing tested 5000 apps and found critical issues in over 900 of them which could have damaged Facebook’s reputation. Testing localised - To date, Global App Testing has tested in over 45 cities around the world for LiveSafe. LiveSafe requires testers to live and work in each target city to capture contextual information outside the limitations of automated testing. Testing Flexibility - By integrating Global App Testing’s crowdsourced testers into their development process, PromoFarma have been able to decrease their cycle time from monthly to every two weeks.
  • 22. Fundamentals of Crowdsourced Testing Who is in your crowd? ● Professional testers around the world who: ○ Do this for a living ○ Do this on the side of their professional job ○ Are retired from testing ● Meet some of them:
  • 23. Fundamentals of Crowdsourced Testing Quality of Results ● Results need to: ○ Be impactful ○ Be moderated ○ Be reproducible with clear steps ○ Be on time ○ Help improve your release processes and workflows ✓
  • 24. Fundamentals of Crowdsourced Testing Can I do this myself? Isn’t this just beta testing? Build your own crowd!
  • 25. Fundamentals of Crowdsourced Testing How to get started 1. Request a consultation 2. Pick a plan 3. Onboard 4. Start testing
  • 26. Fundamentals of Crowdsourced Testing Questions? nick@globalapptesting.com / beth@globalapptesting.com