Using Crowdsourced
Testing to Turbocharge
your Development Team
What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
QA that FITS IN THE DEV PROCESS
“Shifting Left”
Building quality in from the start
Dev-Owned QA
The Upside
- Bugs are caught faster
- There’s less room for
communication errors
- Keeps development agile
Dev-Owned QA
The Downside
- Time is spent on testing, not
building
- Delays in release schedule
- Because of this “double
duty,” things fall through the
cracks
Solution?
Testing that keeps up with agile development
Crowdsourced Testing
How does it turbocharge your team?
Write Tests
Write & run functional tests through
UI, API or CLI
How Rainforest Works
Run Tests
Each test is sent to 3 trained testers from
our on-demand crowd of 50K testers
Result Verification
Rainforest algorithms verify the accuracy
and quality of the tester results
Results Returned
Results are returned via Rainforest platform
or directly into CI or bug trackers
Expertise
The average tester has been working with
Rainforest for 16 months
The Rainforest Crowd Difference
Consistency
68% of testers execute more than 50
Rainforest tests each week
Continued Learning
Our tester pool completes over 15,000 QA
training sessions each week
Machine Learning
Ensures that each test run meets our
standard for quality
Rainforest DevX
Using crowdsourced testers to run tests and provide
deterministic results within existing workflows
How Rainforest DevX Works
Rainforest CLI
Benefits of Rainforest DevX
Run all tests synchronously for quick results
Save developer time and resources by allowing the crowd to execute test cases
Testing Flexibility
Test at any point within your release process
Reduce test management overhead
Eliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into
Your Development Workflow
“Our devs realized that they wouldn’t
have to leave their code editor to
write a test for something they had
just developed... Rainforest DevX
makes it a lot easier to maintain
and refactor our tests
Mitch Stewart, CTO, Guru
“We love that we can drive
Rainforest from the command line
and control the scope of the tests
and cherry pick the browsers we
want to run tests on
Welling LaGrone, Director of Software Engineering,
America’s Test Kitchen
$3.3 MMSaved annually over in-house QA
557 HRSSaved on testing per month
30 XSpeed of an in-house team
Customer Stats
LEARN MORE
To find out more about streamlining testing…
Contact: info@rainforestqa.com
Github: @rainforestapp
Follow: @rainforest_eng

Using Crowdsourced Testing to Turbocharge your Development Team

  • 1.
    Using Crowdsourced Testing toTurbocharge your Development Team
  • 2.
    What does traditionalQA look like? ▸ Write test cases ▹ Feature tests, regression tests, etc ▸ Execute tests ▹ Manual or Automated ▸ Reporting bugs ▸ Feedback Loop ▸ Bug remediation
  • 3.
    Traditional QA DOESN’TFIT IN THE DEV PROCESS ▸ Tests exist outside of development environment ▹ Most developers’ workflow takes place in their local environment ▸ Testing requires a comprehensive review of functionality ▹ It goes beyond the scope of just one change ▸ Tests updated separately from what is being tested ▹ Versions of test and code must match
  • 4.
    QA that FITSIN THE DEV PROCESS “Shifting Left” Building quality in from the start
  • 5.
    Dev-Owned QA The Upside -Bugs are caught faster - There’s less room for communication errors - Keeps development agile
  • 6.
    Dev-Owned QA The Downside -Time is spent on testing, not building - Delays in release schedule - Because of this “double duty,” things fall through the cracks
  • 7.
    Solution? Testing that keepsup with agile development
  • 8.
    Crowdsourced Testing How doesit turbocharge your team?
  • 9.
    Write Tests Write &run functional tests through UI, API or CLI How Rainforest Works Run Tests Each test is sent to 3 trained testers from our on-demand crowd of 50K testers Result Verification Rainforest algorithms verify the accuracy and quality of the tester results Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers
  • 10.
    Expertise The average testerhas been working with Rainforest for 16 months The Rainforest Crowd Difference Consistency 68% of testers execute more than 50 Rainforest tests each week Continued Learning Our tester pool completes over 15,000 QA training sessions each week Machine Learning Ensures that each test run meets our standard for quality
  • 11.
    Rainforest DevX Using crowdsourcedtesters to run tests and provide deterministic results within existing workflows
  • 12.
  • 13.
  • 14.
    Benefits of RainforestDevX Run all tests synchronously for quick results Save developer time and resources by allowing the crowd to execute test cases Testing Flexibility Test at any point within your release process Reduce test management overhead Eliminate versioning problems by coupling test expectations with the code being tested Bring Regression Testing into Your Development Workflow
  • 15.
    “Our devs realizedthat they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our tests Mitch Stewart, CTO, Guru
  • 16.
    “We love thatwe can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests on Welling LaGrone, Director of Software Engineering, America’s Test Kitchen
  • 17.
    $3.3 MMSaved annuallyover in-house QA 557 HRSSaved on testing per month 30 XSpeed of an in-house team Customer Stats
  • 18.
    LEARN MORE To findout more about streamlining testing… Contact: info@rainforestqa.com Github: @rainforestapp Follow: @rainforest_eng