Jenkins User Conference                          San Francisco, Oct 2nd 2011          Extreme Testing          with Jenkin...
Jenkins User Conference                      San Francisco, Oct 2nd 2011                      Selenium’s #1, baby!
Jenkins User Conference   San Francisco, Oct 2nd 2011     2 Extreme Stories        In the cloud        In the garage
Jenkins User Conference                 San Francisco, Oct 2nd 2011     Mantra:  • Parallelizability (p15y) leads to fast ...
Jenkins User Conference                San Francisco, Oct 2nd 2011  • Q: Want happy customers?  • A: Use parallel-ready te...
Jenkins User Conference           San Francisco, Oct 2nd 2011   Story #1- Massive testing (in the cloud)
Jenkins User Conference       San Francisco, Oct 2nd 2011   A large domestic airline
Jenkins User Conference                San Francisco, Oct 2nd 2011  • Build and test entire site in 20 minutes.  • (10 min...
Jenkins User Conference   San Francisco, Oct 2nd 2011   Parallelism x2!
Jenkins User Conference                      San Francisco, Oct 2nd 2011   Jenkins  • 1 Jenkins master  • 10 physical slav...
Jenkins User Conference             San Francisco, Oct 2nd 2011   JBehave  • Every story is written with JBehave  • JBehav...
Jenkins User Conference               San Francisco, Oct 2nd 2011   All that... multiplied  • Smoke suite  • Regression su...
Jenkins User Conference               San Francisco, Oct 2nd 2011   Process     • Trunk-based development (aka "Dont      ...
Jenkins User Conference               San Francisco, Oct 2nd 2011   Next...  • Improve reliability, then go for scale and ...
Jenkins User Conference          San Francisco, Oct 2nd 2011   More info about JBehave • https://github.com/paul-   hamman...
Jenkins User Conference           San Francisco, Oct 2nd 2011   Story #2 – Mobile Testing (with Robots!)
Jenkins User Conference             San Francisco, Oct 2nd 2011                      Bitbeambot                 (http://bi...
Jenkins User Conference                 San Francisco, Oct 2nd 2011                      Video Demo                     (c...
Jenkins User Conference                         San Francisco, Oct 2nd 2011   BitbeamBot – What?     • A computer-controll...
Jenkins User Conference             San Francisco, Oct 2nd 2011   BitbeamBot - Why? • Selenium is a software-based robot. ...
Jenkins User Conference            San Francisco, Oct 2nd 2011   The “Clicker” (1st prototype)
Jenkins User Conference   San Francisco, Oct 2nd 2011
Jenkins User Conference                       San Francisco, Oct 2nd 2011   Links: • JBehave: https://github.com/paul-hamm...
Jenkins User Conference          San Francisco, Oct 2nd 2011     Thank You To Our Sponsors         Platinum         Sponso...
Upcoming SlideShare
Loading in …5
×

Extreme Testing with Selenium - @hugs at Jenkins User Conference 2011

4,660 views

Published on

Slides from Jason Huggins' talk at Jenkins User Conference, October 2011 in San Francisco. Title: "Extreme Testing with Selenium - In the Cloud and In the Garage."

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
4,660
On SlideShare
0
From Embeds
0
Number of Embeds
100
Actions
Shares
0
Downloads
100
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Extreme Testing with Selenium - @hugs at Jenkins User Conference 2011

  1. 1. Jenkins User Conference San Francisco, Oct 2nd 2011 Extreme Testing with Jenkins and Selenium Jason Huggins (@hugs) CTO, Cofounder - Sauce Labs Inc Creator - Selenium Saucelabs.com
  2. 2. Jenkins User Conference San Francisco, Oct 2nd 2011 Selenium’s #1, baby!
  3. 3. Jenkins User Conference San Francisco, Oct 2nd 2011 2 Extreme Stories In the cloud In the garage
  4. 4. Jenkins User Conference San Francisco, Oct 2nd 2011 Mantra: • Parallelizability (p15y) leads to fast software builds. • Fast builds lead to happy developers. • Happy developers lead to happy customers.
  5. 5. Jenkins User Conference San Francisco, Oct 2nd 2011 • Q: Want happy customers? • A: Use parallel-ready testing tools!
  6. 6. Jenkins User Conference San Francisco, Oct 2nd 2011 Story #1- Massive testing (in the cloud)
  7. 7. Jenkins User Conference San Francisco, Oct 2nd 2011 A large domestic airline
  8. 8. Jenkins User Conference San Francisco, Oct 2nd 2011 • Build and test entire site in 20 minutes. • (10 min build, 10 min Selenium testing) • Massive parallelism
  9. 9. Jenkins User Conference San Francisco, Oct 2nd 2011 Parallelism x2!
  10. 10. Jenkins User Conference San Francisco, Oct 2nd 2011 Jenkins • 1 Jenkins master • 10 physical slaves • 10 Virtual IPs per slave • 100 potential total nodes • Each Jenkins executor on client side couldgenerate ~30 threads at Sauce for cloud testing • 100 x 30 -> 3000 potential parallel threads of test execution. * * Current use about 30-300 cloud browsers running tests at any give time throughout the entire day.
  11. 11. Jenkins User Conference San Francisco, Oct 2nd 2011 JBehave • Every story is written with JBehave • JBehavecan parallelize each story. • JBehave -> regex -> groovy page objects- >java -> Selenium2 • Each story compiles to an end-to-end full stack + Selenium test run.
  12. 12. Jenkins User Conference San Francisco, Oct 2nd 2011 All that... multiplied • Smoke suite • Regression suite • Team-specific feature testing • plus • Component tests • JavaScript unit tests (jasmine)
  13. 13. Jenkins User Conference San Francisco, Oct 2nd 2011 Process • Trunk-based development (aka "Dont break the build!") • Branch per release • At any given moment, 2 lines (release branch + trunk) are in use. • Fixes go to trunk first, then branch • Feature toggles (aka "Feature flags") • Every jBehave test suite stands up its own app stack for testing. (Amdahls Law)
  14. 14. Jenkins User Conference San Francisco, Oct 2nd 2011 Next... • Improve reliability, then go for scale and speed
  15. 15. Jenkins User Conference San Francisco, Oct 2nd 2011 More info about JBehave • https://github.com/paul- hammant/jbehave-webdriver-tutorial
  16. 16. Jenkins User Conference San Francisco, Oct 2nd 2011 Story #2 – Mobile Testing (with Robots!)
  17. 17. Jenkins User Conference San Francisco, Oct 2nd 2011 Bitbeambot (http://bitbeam.org)
  18. 18. Jenkins User Conference San Francisco, Oct 2nd 2011 Video Demo (click to start)
  19. 19. Jenkins User Conference San Francisco, Oct 2nd 2011 BitbeamBot – What? • A computer-controlled (CNC) robot for testing applications on mobile devices • Open Source components: – Electronics: Arduino – Mechanics: Bitbeam • Lego Technic compatible building toy • Made from Basswood • Designed with 3D tool OpenSCAD • Lasercut at TechShop San Francisco – Software: Python, Selenium
  20. 20. Jenkins User Conference San Francisco, Oct 2nd 2011 BitbeamBot - Why? • Selenium is a software-based robot. • Selenium’s mission is to mimic and automate how users interact with an application. • For mobile, this means handling real devices. • BitbeamBot is an experiment to take Selenium out of the screen and into the real world.
  21. 21. Jenkins User Conference San Francisco, Oct 2nd 2011 The “Clicker” (1st prototype)
  22. 22. Jenkins User Conference San Francisco, Oct 2nd 2011
  23. 23. Jenkins User Conference San Francisco, Oct 2nd 2011 Links: • JBehave: https://github.com/paul-hammant/jbehave- webdriver-tutorial • Selenium: http://seleniumhq.org • Bitbeam: http://bitbeam.org https://github.com/hugs/bitbeam • Sauce Labs: http://saucelabs.com • Me (Jason Huggins): http://twitter.com/hugs
  24. 24. Jenkins User Conference San Francisco, Oct 2nd 2011 Thank You To Our Sponsors Platinum Sponsor Gold Sponsor Silver Sponsor Bronze Sponsors

×