SlideShare a Scribd company logo
Using Crowdsourced
Testing to Turbocharge
your Development Team
What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
QA that FITS IN THE DEV PROCESS
“Shifting Left”
Building quality in from the start
Dev-Owned QA
The Upside
- Bugs are caught faster
- There’s less room for
communication errors
- Keeps development agile
Dev-Owned QA
The Downside
- Time is spent on testing, not
building
- Delays in release schedule
- Because of this “double
duty,” things fall through the
cracks
Solution?
Testing that keeps up with agile development
Crowdsourced Testing
How does it turbocharge your team?
Write Tests
Write & run functional tests through
UI, API or CLI
How Rainforest Works
Run Tests
Each test is sent to 3 trained testers from
our on-demand crowd of 50K testers
Result Verification
Rainforest algorithms verify the accuracy
and quality of the tester results
Results Returned
Results are returned via Rainforest platform
or directly into CI or bug trackers
Expertise
The average tester has been working with
Rainforest for 16 months
The Rainforest Crowd Difference
Consistency
68% of testers execute more than 50
Rainforest tests each week
Continued Learning
Our tester pool completes over 15,000 QA
training sessions each week
Machine Learning
Ensures that each test run meets our
standard for quality
Rainforest DevX
Using crowdsourced testers to run tests and provide
deterministic results within existing workflows
How Rainforest DevX Works
Rainforest CLI
Benefits of Rainforest DevX
Run all tests synchronously for quick results
Save developer time and resources by allowing the crowd to execute test cases
Testing Flexibility
Test at any point within your release process
Reduce test management overhead
Eliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into
Your Development Workflow
“Our devs realized that they wouldn’t
have to leave their code editor to
write a test for something they had
just developed... Rainforest DevX
makes it a lot easier to maintain
and refactor our tests
Mitch Stewart, CTO, Guru
“We love that we can drive
Rainforest from the command line
and control the scope of the tests
and cherry pick the browsers we
want to run tests on
Welling LaGrone, Director of Software Engineering,
America’s Test Kitchen
$3.3 MMSaved annually over in-house QA
557 HRSSaved on testing per month
30 XSpeed of an in-house team
Customer Stats
LEARN MORE
To find out more about streamlining testing…
Contact: info@rainforestqa.com
Github: @rainforestapp
Follow: @rainforest_eng

More Related Content

What's hot

Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
drluckyspin
 
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience
 
Continuous delivery in practice (public)
Continuous delivery in practice (public)Continuous delivery in practice (public)
Continuous delivery in practice (public)
Tzach Zohar
 
DevOps
DevOpsDevOps
DevOps
Sunny Poswal
 
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
Steve Lange
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
gaoliang641
 
Team wide testing
Team wide testingTeam wide testing
Team wide testing
Ethan Huang
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
Dr. Alexander Schwartz
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
Hicham El Hammouchi
 
Quality not-speed-for-distrobution
Quality not-speed-for-distrobutionQuality not-speed-for-distrobution
Quality not-speed-for-distrobution
bownyboy
 
Unit testing for project managers
Unit testing for project managersUnit testing for project managers
Unit testing for project managers
Zend by Rogue Wave Software
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructure
Jun Li
 
How We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated TestingHow We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated Testing
Gareth Marland
 
People factor as failure reason of Agile adoption
People factor as failure reason of Agile adoptionPeople factor as failure reason of Agile adoption
People factor as failure reason of Agile adoption
Mikalai Alimenkou
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
JAXLondon2014
 
Why your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating itWhy your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating it
Farooq Ali
 
Continuous Integration and Builds
Continuous Integration and BuildsContinuous Integration and Builds
Continuous Integration and Builds
Bhavin Javia
 
Quality Loopback
Quality LoopbackQuality Loopback
Quality Loopback
Omar Bashir
 
Introduction to Automated Testing
Introduction to Automated TestingIntroduction to Automated Testing
Introduction to Automated Testing
Lars Thorup
 

What's hot (19)

Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
 
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
CodeScience Webinar - Automated Testing for Your Salesforce App — Tips and Tr...
 
Continuous delivery in practice (public)
Continuous delivery in practice (public)Continuous delivery in practice (public)
Continuous delivery in practice (public)
 
DevOps
DevOpsDevOps
DevOps
 
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
PHX - Session #2 Test Driven Development: Improving .NET Application Performa...
 
Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
 
Team wide testing
Team wide testingTeam wide testing
Team wide testing
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
 
Quality not-speed-for-distrobution
Quality not-speed-for-distrobutionQuality not-speed-for-distrobution
Quality not-speed-for-distrobution
 
Unit testing for project managers
Unit testing for project managersUnit testing for project managers
Unit testing for project managers
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructure
 
How We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated TestingHow We Build Confidence with Continuous Integration and Automated Testing
How We Build Confidence with Continuous Integration and Automated Testing
 
People factor as failure reason of Agile adoption
People factor as failure reason of Agile adoptionPeople factor as failure reason of Agile adoption
People factor as failure reason of Agile adoption
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
 
Why your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating itWhy your company loves to welcome change but sucks at accommodating it
Why your company loves to welcome change but sucks at accommodating it
 
Continuous Integration and Builds
Continuous Integration and BuildsContinuous Integration and Builds
Continuous Integration and Builds
 
Quality Loopback
Quality LoopbackQuality Loopback
Quality Loopback
 
Introduction to Automated Testing
Introduction to Automated TestingIntroduction to Automated Testing
Introduction to Automated Testing
 

Viewers also liked

The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2
babypeanut2424
 
The rain forest
The rain forestThe rain forest
The rain forest
dolo12962
 
Rainforest Interactive Powerpoint
Rainforest Interactive PowerpointRainforest Interactive Powerpoint
Rainforest Interactive Powerpoint
verburam
 
Rainforest Presentation
Rainforest PresentationRainforest Presentation
Rainforest Presentation
thomp2al
 
Rainforests Powerpoint
Rainforests PowerpointRainforests Powerpoint
Rainforests Powerpoint
Katie Bucherati
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
Seth Familian
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
Natasha Murashev
 

Viewers also liked (7)

The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2The four layers of the amazon rainforest emmas project2
The four layers of the amazon rainforest emmas project2
 
The rain forest
The rain forestThe rain forest
The rain forest
 
Rainforest Interactive Powerpoint
Rainforest Interactive PowerpointRainforest Interactive Powerpoint
Rainforest Interactive Powerpoint
 
Rainforest Presentation
Rainforest PresentationRainforest Presentation
Rainforest Presentation
 
Rainforests Powerpoint
Rainforests PowerpointRainforests Powerpoint
Rainforests Powerpoint
 
Visual Design with Data
Visual Design with DataVisual Design with Data
Visual Design with Data
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 

Similar to Using Crowdsourced Testing to Turbocharge your Development Team

Devops Mindset Essentials
Devops Mindset EssentialsDevops Mindset Essentials
Devops Mindset Essentials
Willy-Peter Schaub
 
What_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheetWhat_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheet
Daniel Acee
 
What-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheetWhat-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheet
Kevin Woods
 
Rainforest QA InfoSheet
Rainforest QA InfoSheetRainforest QA InfoSheet
Rainforest QA InfoSheet
Emily Nansen
 
Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...
Tomas Riha
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
TechWell
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
Neotys
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009
Pepe
 
Best Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdfBest Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdf
pCloudy
 
product Qa workflow
product Qa workflowproduct Qa workflow
product Qa workflow
tanvir afzal
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
Tomas Riha
 
Fllow con 2014
Fllow con 2014 Fllow con 2014
Fllow con 2014
gbgruver
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
Shalu Ahuja
 
Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...
Tomas Riha
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
Angela Dugan
 
The Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOpsThe Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOps
TEST Huddle
 
Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps World
QASymphony
 
Agile testing
Agile testingAgile testing
Agile testing
Raj Indugula
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
Sauce Labs
 

Similar to Using Crowdsourced Testing to Turbocharge your Development Team (20)

Devops Mindset Essentials
Devops Mindset EssentialsDevops Mindset Essentials
Devops Mindset Essentials
 
What_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheetWhat_is_Rainforest_QA_-_InfoSheet
What_is_Rainforest_QA_-_InfoSheet
 
What-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheetWhat-is-RainforestQA-InfoSheet
What-is-RainforestQA-InfoSheet
 
Rainforest QA InfoSheet
Rainforest QA InfoSheetRainforest QA InfoSheet
Rainforest QA InfoSheet
 
Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...Continuous delivery its not about the technology, its about the people. @sats...
Continuous delivery its not about the technology, its about the people. @sats...
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009
 
Best Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdfBest Practices to Optimize Continuous Testing in DevOps.pdf
Best Practices to Optimize Continuous Testing in DevOps.pdf
 
product Qa workflow
product Qa workflowproduct Qa workflow
product Qa workflow
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
 
Fllow con 2014
Fllow con 2014 Fllow con 2014
Fllow con 2014
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
 
Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...Continuous delivery its not about the technology, its about the people. @pipe...
Continuous delivery its not about the technology, its about the people. @pipe...
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
The Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOpsThe Evolution of Test Automation for DevOps
The Evolution of Test Automation for DevOps
 
Building Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps WorldBuilding Better Collaboration Between Development and Testing in a DevOps World
Building Better Collaboration Between Development and Testing in a DevOps World
 
Agile testing
Agile testingAgile testing
Agile testing
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
 

Recently uploaded

Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 

Recently uploaded (20)

Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 

Using Crowdsourced Testing to Turbocharge your Development Team

  • 1. Using Crowdsourced Testing to Turbocharge your Development Team
  • 2. What does traditional QA look like? ▸ Write test cases ▹ Feature tests, regression tests, etc ▸ Execute tests ▹ Manual or Automated ▸ Reporting bugs ▸ Feedback Loop ▸ Bug remediation
  • 3. Traditional QA DOESN’T FIT IN THE DEV PROCESS ▸ Tests exist outside of development environment ▹ Most developers’ workflow takes place in their local environment ▸ Testing requires a comprehensive review of functionality ▹ It goes beyond the scope of just one change ▸ Tests updated separately from what is being tested ▹ Versions of test and code must match
  • 4. QA that FITS IN THE DEV PROCESS “Shifting Left” Building quality in from the start
  • 5. Dev-Owned QA The Upside - Bugs are caught faster - There’s less room for communication errors - Keeps development agile
  • 6. Dev-Owned QA The Downside - Time is spent on testing, not building - Delays in release schedule - Because of this “double duty,” things fall through the cracks
  • 7. Solution? Testing that keeps up with agile development
  • 8. Crowdsourced Testing How does it turbocharge your team?
  • 9. Write Tests Write & run functional tests through UI, API or CLI How Rainforest Works Run Tests Each test is sent to 3 trained testers from our on-demand crowd of 50K testers Result Verification Rainforest algorithms verify the accuracy and quality of the tester results Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers
  • 10. Expertise The average tester has been working with Rainforest for 16 months The Rainforest Crowd Difference Consistency 68% of testers execute more than 50 Rainforest tests each week Continued Learning Our tester pool completes over 15,000 QA training sessions each week Machine Learning Ensures that each test run meets our standard for quality
  • 11. Rainforest DevX Using crowdsourced testers to run tests and provide deterministic results within existing workflows
  • 14. Benefits of Rainforest DevX Run all tests synchronously for quick results Save developer time and resources by allowing the crowd to execute test cases Testing Flexibility Test at any point within your release process Reduce test management overhead Eliminate versioning problems by coupling test expectations with the code being tested Bring Regression Testing into Your Development Workflow
  • 15. “Our devs realized that they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our tests Mitch Stewart, CTO, Guru
  • 16. “We love that we can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests on Welling LaGrone, Director of Software Engineering, America’s Test Kitchen
  • 17. $3.3 MMSaved annually over in-house QA 557 HRSSaved on testing per month 30 XSpeed of an in-house team Customer Stats
  • 18. LEARN MORE To find out more about streamlining testing… Contact: info@rainforestqa.com Github: @rainforestapp Follow: @rainforest_eng