SlideShare a Scribd company logo
1Webinar
and
Present
Introducing
performance and
functional
automation early
with Continuous
Integration
2
CI Gets More Testing
TODAY’S PRESENTERS
Andy Pemberton: CloudBees, Sr. Dir. Solution Architecture
Mike Ostenberg: SOASTA, Dir. Solutions Engineering
Brad Johnson: SOASTA, VP Product
TWO COMPANIES, A SINGLE SOLUTION
- the leader in Mobile and Cloud Testing
- the Jenkins Enterprise company
Together, we offer a complete cloud-based service:
Continuous Delivery for Web & Mobile
@apemberton
@bradjohnsonsv
3
• Achieving (even) more test coverage with Jenkins
• Utilizing cloud in development and test
• CloudBees and Jenkins
• From Continuous Integration to Continuous Delivery
• CI with SOASTA CloudTest (load) and TouchTest (mobile)
Questions:
Submit in the question box during event
4
Testing
The Legacy of….WAIT
Ut
Unit Testing
Ft
Functional
Testing
Development Testing Operations
Pt
Performance
Testing
Mo
Monitoring
Legacy Approach: Silos and waiting
TIME
5
Eliminating Delays Compresses Time
Enabling more testing to be done earlier and more often
Ut
Unit Testing
Ft
Functional
Testing
Testing
Pt
Performance
Testing
Mo
Monitoring
Legacy Approach: Silos and waiting
Agile Approach: Automation and Continuous Testing
OperationsDevelopment
Dev Ops
Testing
TIME
6
* Source: Gartner, “Blueprint for Adding Continuous Integration as a Start to Your Continuous Delivery Process” Sean Kenefick, Aug 25, 2014
Traditionally
later-stage
testing!
Perf & mobile
testing plugins
enhance value
across delivery
cycle
7
8
Andy Pemberton
@apemberton
o #1 OSS CI server
o Written in Java
o Highly Extensible
o Founded ~2005
o Easy to install / use
o Extensible via 1000+ plugins
o Widely adopted
o 80K+ installations
o CloudBees knows Jenkins
o On-premise, cloud and hybrid
o Expert support
o Enterprise plugins
Have you met Jenkins?
o Jenkins founder, Kohsuke Kawaguchi, CloudBees CTO
o We optimize Jenkins for the enterprise
o Jenkins Operations Center
o Jenkins OSS Support
o Enterprise-class plugins
o Commit code and support the Jenkins Community
o Jenkins training and consulting
o Jenkins User Conferences (JUC) and newsletters
o …we are the Jenkins Enterprise experts!
CloudBees
CloudBees Jenkins Products
On-Premise In the Cloud Hybrid
No matter how you use Jenkins
Jenkins Enterprise
by CloudBees
Jenkins Operations Center
by CloudBees
DEV@cloud DEV@cloud
Hybrid
Jenkins: the Hub of Continuous Delivery
Source Code
Binaries
Quality Analysis Functional Test
Performance / Load Test
Production
Jenkins: the Hub of Continuous Delivery
Source Code
Binaries
Quality Analysis Functional Test
Performance / Load Test
Production
o “Survival is not mandatory
(nor is adopting DevOps)”
o Gene Kim, Wall Street Journal
- CIO Journal DevOps piece
o Seek out opportunities for
automation - testing is an
ideal first step
o Load, functional, and
mobile testing have been
challenging…
DevOps is a Journey
http://blogs.wsj.com/cio/2014/05/22/enterprise-devops-adoption-isnt-mandatory-but-neither-is-
survival/
8x more
frequent
releases
8000x faster
release process
2x higher
releases
success
12x faster
defect fixes
DevOps
15
Mike Ostenberg
16
o Demo:
• Creating a quick functional test in TouchTest
• Creating a quick performance test in CloudTest
• Running Load and Performance Tests from Jenkins:
• Play TouchTest/CloudTest tests from Jenkins
• Setting Thresholds to automatically alert on poor performance
• Plotting performance trending data directly in Jenkins
• Reviewing detailed results directly in Jenkins
• Jenkins Enterprise by CloudBees enhancements
• Add templates
• Add folders
• Add roles and permissions
17
Expertise
18
TouchTest
o Run MATT utility to create
testable application
o Install Testable application
on device
CloudTest
o Install conductor on laptop
o Modify mobile device proxy
settings
Jenkins
o Install SOASTA PlugIn
o Install Plot PlugIn
o Install Jenkins Enterprise by
CloudBees
• Open Source: online at jenkins-ci.org
• Automatically available on CloudBees DEV@cloud
• Complete control over CloudTest/TouchTest Automation from within your
Jenkins builds:
• Totally integrated into Jenkins environment
SOASTA Jenkins Plug-in
Jenkins Enterprise by CloudBees – Folders Plus Plugin
Jenkins Enterprise by CloudBees – Role-based Access
Control
Jenkins Enterprise by CloudBees – Templates Plugin
23
Thanks & Q&A
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
Knowledge Center
• White Papers
• Webinar Recordings
• Case Studies
CloudLink Community
• Support
• Tutorials
• Video
RESOURCES
Contact CloudBees
www.cloudbees.com
info@cloudbees.com
1.781.404.5100
Follow us:
twitter.com/cloudbees
facebook.com/CloudBees
www.SOASTA.com www.CloudBees.com/jenkins
blog.cloudbees.com
developer.cloudbees.com
• Platform Services
• Frameworks

More Related Content

What's hot

Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Mike Villiger
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the CloudTesting In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
SOASTA
 
Appium vs Espresso and XCUI Test
Appium vs Espresso and XCUI TestAppium vs Espresso and XCUI Test
Appium vs Espresso and XCUI Test
Perfecto by Perforce
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide shareFinal tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
SOASTA
 
Automation Testing Approach for Responsive Web Design
Automation Testing Approach for Responsive Web DesignAutomation Testing Approach for Responsive Web Design
Automation Testing Approach for Responsive Web Design
Agile Testing Alliance
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Make the Shift from Manual to Automation with Open Source
Make the Shift from Manual to Automation with Open SourceMake the Shift from Manual to Automation with Open Source
Make the Shift from Manual to Automation with Open Source
Perfecto by Perforce
 
Metrics-driven Continuous Delivery
Metrics-driven Continuous DeliveryMetrics-driven Continuous Delivery
Metrics-driven Continuous Delivery
Andrew Phillips
 
Continuous Delivery, Continuous Integration
Continuous Delivery, Continuous Integration Continuous Delivery, Continuous Integration
Continuous Delivery, Continuous Integration
Amazon Web Services
 
Mobile UI Testing using Appium and Docker
Mobile UI Testing using Appium and DockerMobile UI Testing using Appium and Docker
Mobile UI Testing using Appium and Docker
Moataz Nabil
 
Continuous delivery applied
Continuous delivery appliedContinuous delivery applied
Continuous delivery appliedMike McGarr
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
QASymphony
 
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
QASymphony
 
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha CoffmanAutomated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Sauce Labs
 
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
Edureka!
 
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
Sauce Labs
 
Overview the Challenges and Limitations of Android App Automation with Espres...
Overview the Challenges and Limitations of Android App Automation with Espres...Overview the Challenges and Limitations of Android App Automation with Espres...
Overview the Challenges and Limitations of Android App Automation with Espres...
Sauce Labs
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
TechWell
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Jennifer Finney
 
ATAGTR2017 Wearable App Testing
ATAGTR2017 Wearable App TestingATAGTR2017 Wearable App Testing
ATAGTR2017 Wearable App Testing
Agile Testing Alliance
 

What's hot (20)

Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the CloudTesting In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
 
Appium vs Espresso and XCUI Test
Appium vs Espresso and XCUI TestAppium vs Espresso and XCUI Test
Appium vs Espresso and XCUI Test
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide shareFinal tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
 
Automation Testing Approach for Responsive Web Design
Automation Testing Approach for Responsive Web DesignAutomation Testing Approach for Responsive Web Design
Automation Testing Approach for Responsive Web Design
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Make the Shift from Manual to Automation with Open Source
Make the Shift from Manual to Automation with Open SourceMake the Shift from Manual to Automation with Open Source
Make the Shift from Manual to Automation with Open Source
 
Metrics-driven Continuous Delivery
Metrics-driven Continuous DeliveryMetrics-driven Continuous Delivery
Metrics-driven Continuous Delivery
 
Continuous Delivery, Continuous Integration
Continuous Delivery, Continuous Integration Continuous Delivery, Continuous Integration
Continuous Delivery, Continuous Integration
 
Mobile UI Testing using Appium and Docker
Mobile UI Testing using Appium and DockerMobile UI Testing using Appium and Docker
Mobile UI Testing using Appium and Docker
 
Continuous delivery applied
Continuous delivery appliedContinuous delivery applied
Continuous delivery applied
 
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
Quality Jam 2017: Elise Carmichael and Corey Pyle "Jumpstarting Your Test Aut...
 
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
Quality Jam 2017: Kevin Dunne "Macro Trends and Useful Tools that 'Get It'"
 
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha CoffmanAutomated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
 
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
DevOps Testing | Continuous Testing In DevOps | DevOps Tutorial | DevOps Trai...
 
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
 
Overview the Challenges and Limitations of Android App Automation with Espres...
Overview the Challenges and Limitations of Android App Automation with Espres...Overview the Challenges and Limitations of Android App Automation with Espres...
Overview the Challenges and Limitations of Android App Automation with Espres...
 
Continuous Performance Testing: The New Standard
Continuous Performance Testing: The New StandardContinuous Performance Testing: The New Standard
Continuous Performance Testing: The New Standard
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
 
ATAGTR2017 Wearable App Testing
ATAGTR2017 Wearable App TestingATAGTR2017 Wearable App Testing
ATAGTR2017 Wearable App Testing
 

Viewers also liked

Tsung Intro presentation 2013
Tsung Intro presentation 2013Tsung Intro presentation 2013
Tsung Intro presentation 2013Steffen Larsen
 
Easy distributed load test with Tsung
Easy distributed load test with TsungEasy distributed load test with Tsung
Easy distributed load test with TsungNgoc Dao
 
Appium & Jenkins
Appium & JenkinsAppium & Jenkins
Appium & Jenkins
floriankammermann
 
Continuous Web Performance Monitoring with Jenkins
Continuous Web Performance Monitoring with JenkinsContinuous Web Performance Monitoring with Jenkins
Continuous Web Performance Monitoring with JenkinsMichael Kröll
 
10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5
Sauce Labs
 
Android & iOS Automation Using Appium
Android & iOS Automation Using AppiumAndroid & iOS Automation Using Appium
Android & iOS Automation Using Appium
Mindfire Solutions
 

Viewers also liked (7)

Tsung info
Tsung infoTsung info
Tsung info
 
Tsung Intro presentation 2013
Tsung Intro presentation 2013Tsung Intro presentation 2013
Tsung Intro presentation 2013
 
Easy distributed load test with Tsung
Easy distributed load test with TsungEasy distributed load test with Tsung
Easy distributed load test with Tsung
 
Appium & Jenkins
Appium & JenkinsAppium & Jenkins
Appium & Jenkins
 
Continuous Web Performance Monitoring with Jenkins
Continuous Web Performance Monitoring with JenkinsContinuous Web Performance Monitoring with Jenkins
Continuous Web Performance Monitoring with Jenkins
 
10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5
 
Android & iOS Automation Using Appium
Android & iOS Automation Using AppiumAndroid & iOS Automation Using Appium
Android & iOS Automation Using Appium
 

Similar to How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & CloudBees

How to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery PipelineHow to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery Pipeline
Dynatrace
 
Beyond the Release: CI That Transforms Organizations
Beyond the Release: CI That Transforms OrganizationsBeyond the Release: CI That Transforms Organizations
Beyond the Release: CI That Transforms Organizations
Sauce Labs
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
Nathan Jones
 
Automated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevilleAutomated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevillePromet Source
 
Application Lifecycle Management
Application Lifecycle ManagementApplication Lifecycle Management
Application Lifecycle Management
Amazon Web Services
 
Dev/Test scenarios in DevOps world
Dev/Test scenarios in DevOps worldDev/Test scenarios in DevOps world
Dev/Test scenarios in DevOps world
Davide Benvegnù
 
Modern_Continuous-Integration_Webinar
Modern_Continuous-Integration_WebinarModern_Continuous-Integration_Webinar
Modern_Continuous-Integration_WebinarAbhijit Pendyal
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
Amazon Web Services
 
Innovate Better Through Machine data Analytics
Innovate Better Through Machine data AnalyticsInnovate Better Through Machine data Analytics
Innovate Better Through Machine data Analytics
Hal Rottenberg
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Dynatrace
 
DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?
Michael Elder
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
Karim Fanadka
 
Continuous Testing 2016
Continuous Testing 2016Continuous Testing 2016
Continuous Testing 2016
Karim Fanadka
 
Continuous integration with Jenkins
Continuous integration with JenkinsContinuous integration with Jenkins
Continuous integration with Jenkins
Mohammad Hossein Rimaz
 
CI/CD for mobile at HERE
CI/CD for mobile at HERECI/CD for mobile at HERE
CI/CD for mobile at HERE
Stefan Verhoeff
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
SOASTA
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
Amazon Web Services
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
Amazon Web Services
 
Test Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every BuildTest Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every Build
TechWell
 

Similar to How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & CloudBees (20)

How to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery PipelineHow to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery Pipeline
 
Beyond the Release: CI That Transforms Organizations
Beyond the Release: CI That Transforms OrganizationsBeyond the Release: CI That Transforms Organizations
Beyond the Release: CI That Transforms Organizations
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
 
Automated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevilleAutomated testing DrupalCamp in Asheville
Automated testing DrupalCamp in Asheville
 
Application Lifecycle Management
Application Lifecycle ManagementApplication Lifecycle Management
Application Lifecycle Management
 
Dev/Test scenarios in DevOps world
Dev/Test scenarios in DevOps worldDev/Test scenarios in DevOps world
Dev/Test scenarios in DevOps world
 
Modern_Continuous-Integration_Webinar
Modern_Continuous-Integration_WebinarModern_Continuous-Integration_Webinar
Modern_Continuous-Integration_Webinar
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
 
Innovate Better Through Machine data Analytics
Innovate Better Through Machine data AnalyticsInnovate Better Through Machine data Analytics
Innovate Better Through Machine data Analytics
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
 
DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
Continuous Testing 2016
Continuous Testing 2016Continuous Testing 2016
Continuous Testing 2016
 
Continuous integration with Jenkins
Continuous integration with JenkinsContinuous integration with Jenkins
Continuous integration with Jenkins
 
CI/CD for mobile at HERE
CI/CD for mobile at HERECI/CD for mobile at HERE
CI/CD for mobile at HERE
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
 
Test Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every BuildTest Automation at the Speed of Agile: Making It Work Every Build
Test Automation at the Speed of Agile: Making It Work Every Build
 

More from SOASTA

DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
SOASTA
 
Optimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenueOptimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenue
SOASTA
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak SeasonWebinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
SOASTA
 
Velocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & SyntheticVelocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & Synthetic
SOASTA
 
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
SOASTA
 
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
SOASTA
 
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave MurphyVelocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
SOASTA
 
Radial | SOASTA IR Webinar
Radial | SOASTA IR WebinarRadial | SOASTA IR Webinar
Radial | SOASTA IR Webinar
SOASTA
 
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
SOASTA
 
Ann Ruckstuhl eTail West
Ann Ruckstuhl eTail WestAnn Ruckstuhl eTail West
Ann Ruckstuhl eTail West
SOASTA
 
Webinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTestWebinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTest
SOASTA
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
SOASTA
 
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
SOASTA
 
Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations
SOASTA
 
Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?) Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
SOASTA
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash SalesWebinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
SOASTA
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
SOASTA
 
Business Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOCBusiness Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOC
SOASTA
 
eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation
SOASTA
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 

More from SOASTA (20)

DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
 
Optimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenueOptimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenue
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak SeasonWebinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
 
Velocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & SyntheticVelocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & Synthetic
 
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
 
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
 
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave MurphyVelocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
 
Radial | SOASTA IR Webinar
Radial | SOASTA IR WebinarRadial | SOASTA IR Webinar
Radial | SOASTA IR Webinar
 
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
 
Ann Ruckstuhl eTail West
Ann Ruckstuhl eTail WestAnn Ruckstuhl eTail West
Ann Ruckstuhl eTail West
 
Webinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTestWebinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTest
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
 
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
 
Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations
 
Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?) Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash SalesWebinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
Business Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOCBusiness Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOC
 
eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
 

How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & CloudBees

  • 2. 2 CI Gets More Testing TODAY’S PRESENTERS Andy Pemberton: CloudBees, Sr. Dir. Solution Architecture Mike Ostenberg: SOASTA, Dir. Solutions Engineering Brad Johnson: SOASTA, VP Product TWO COMPANIES, A SINGLE SOLUTION - the leader in Mobile and Cloud Testing - the Jenkins Enterprise company Together, we offer a complete cloud-based service: Continuous Delivery for Web & Mobile @apemberton @bradjohnsonsv
  • 3. 3 • Achieving (even) more test coverage with Jenkins • Utilizing cloud in development and test • CloudBees and Jenkins • From Continuous Integration to Continuous Delivery • CI with SOASTA CloudTest (load) and TouchTest (mobile) Questions: Submit in the question box during event
  • 4. 4 Testing The Legacy of….WAIT Ut Unit Testing Ft Functional Testing Development Testing Operations Pt Performance Testing Mo Monitoring Legacy Approach: Silos and waiting TIME
  • 5. 5 Eliminating Delays Compresses Time Enabling more testing to be done earlier and more often Ut Unit Testing Ft Functional Testing Testing Pt Performance Testing Mo Monitoring Legacy Approach: Silos and waiting Agile Approach: Automation and Continuous Testing OperationsDevelopment Dev Ops Testing TIME
  • 6. 6 * Source: Gartner, “Blueprint for Adding Continuous Integration as a Start to Your Continuous Delivery Process” Sean Kenefick, Aug 25, 2014 Traditionally later-stage testing! Perf & mobile testing plugins enhance value across delivery cycle
  • 7. 7
  • 9. o #1 OSS CI server o Written in Java o Highly Extensible o Founded ~2005 o Easy to install / use o Extensible via 1000+ plugins o Widely adopted o 80K+ installations o CloudBees knows Jenkins o On-premise, cloud and hybrid o Expert support o Enterprise plugins Have you met Jenkins?
  • 10. o Jenkins founder, Kohsuke Kawaguchi, CloudBees CTO o We optimize Jenkins for the enterprise o Jenkins Operations Center o Jenkins OSS Support o Enterprise-class plugins o Commit code and support the Jenkins Community o Jenkins training and consulting o Jenkins User Conferences (JUC) and newsletters o …we are the Jenkins Enterprise experts! CloudBees
  • 11. CloudBees Jenkins Products On-Premise In the Cloud Hybrid No matter how you use Jenkins Jenkins Enterprise by CloudBees Jenkins Operations Center by CloudBees DEV@cloud DEV@cloud Hybrid
  • 12. Jenkins: the Hub of Continuous Delivery Source Code Binaries Quality Analysis Functional Test Performance / Load Test Production
  • 13. Jenkins: the Hub of Continuous Delivery Source Code Binaries Quality Analysis Functional Test Performance / Load Test Production
  • 14. o “Survival is not mandatory (nor is adopting DevOps)” o Gene Kim, Wall Street Journal - CIO Journal DevOps piece o Seek out opportunities for automation - testing is an ideal first step o Load, functional, and mobile testing have been challenging… DevOps is a Journey http://blogs.wsj.com/cio/2014/05/22/enterprise-devops-adoption-isnt-mandatory-but-neither-is- survival/ 8x more frequent releases 8000x faster release process 2x higher releases success 12x faster defect fixes DevOps
  • 16. 16 o Demo: • Creating a quick functional test in TouchTest • Creating a quick performance test in CloudTest • Running Load and Performance Tests from Jenkins: • Play TouchTest/CloudTest tests from Jenkins • Setting Thresholds to automatically alert on poor performance • Plotting performance trending data directly in Jenkins • Reviewing detailed results directly in Jenkins • Jenkins Enterprise by CloudBees enhancements • Add templates • Add folders • Add roles and permissions
  • 18. 18 TouchTest o Run MATT utility to create testable application o Install Testable application on device CloudTest o Install conductor on laptop o Modify mobile device proxy settings Jenkins o Install SOASTA PlugIn o Install Plot PlugIn o Install Jenkins Enterprise by CloudBees
  • 19. • Open Source: online at jenkins-ci.org • Automatically available on CloudBees DEV@cloud • Complete control over CloudTest/TouchTest Automation from within your Jenkins builds: • Totally integrated into Jenkins environment SOASTA Jenkins Plug-in
  • 20. Jenkins Enterprise by CloudBees – Folders Plus Plugin
  • 21. Jenkins Enterprise by CloudBees – Role-based Access Control
  • 22. Jenkins Enterprise by CloudBees – Templates Plugin
  • 23. 23 Thanks & Q&A Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest Knowledge Center • White Papers • Webinar Recordings • Case Studies CloudLink Community • Support • Tutorials • Video RESOURCES Contact CloudBees www.cloudbees.com info@cloudbees.com 1.781.404.5100 Follow us: twitter.com/cloudbees facebook.com/CloudBees www.SOASTA.com www.CloudBees.com/jenkins blog.cloudbees.com developer.cloudbees.com • Platform Services • Frameworks

Editor's Notes

  1. So, based on the poll results…. (there is a mix of users that test in development, staging, and production environment) … In today’s webinar, we will be focusing on performance testing as a continuous process, testing across your software product lifecycle - devops and perf eng is a team effort! Load testing has evolved along with continuous delivery and now requires that developers eliminate performance issues on their desktop while test and operations teams validate from the test lab to live production systems. Your test platform must be adaptable and accessible testing behind and beyond firewalls.  Generally speaking, traditionally, testing has begun at the component level and works outward toward the integration of the entire system. At each point of this process, there are different techniques to testing; however, with the market being so competitive and your users/customers expecting so much out of your product, the time to get this important function done may be compromised. Unfortunately, testing is often the bottleneck that causes teams to wait as manual testing completes or redundant testing tasks are executed by siloed test teams. The goal is not to introduce delays but instead to continually test throughout the lifecycle.
  2. While enabling more testing at all stages of the product lifecycle, we want to eliminate delays and compress the time to release. This approach requires communication and collaboration between various stakeholders - dev folks, QA team, the product owner and the Ops team. Whether your web app is for external or internal users, the performance of the app is critical – they want a fast and responsive site to get their job done. Most of us have been through this … but do we have the patience to sit and watch the spinning circle and see the pages render slowly down the browser? Perceived wait time can causes positive or negative reactions to your product. In an agile approach, automation and continuous testing compress time. Developers test in short iterations on their local machines and conduct unit tests. A big change we see in more agile shops using SOASTA is that the Dev team is empowered to build automated functional and performance tests on their code. Performance has traditionally been the domain of specialized teams, and still is, but if Developers eliminate code-level performance bugs, the Perf Team can build better and more complex tests to isolate issues outside of the code. Test and Ops team can then focus on tests with different objectives behind existing firewalls … The ops team can also do the same approach, working in conjunction with the developers. But the difference here is that the testing gets expanded focusing on areas of the code that involve your infrastructure – database, APIs / web services, smoke tests, custom code, critical single page apps. This bottom-up testing scenario gives tests low level components combined in clusters to validate the performance of a specific software function with increasingly complex and user-focused testing as time goes on.
  3. Work very closely with the community – lead sponsor of Jenkins User Conferences Focus is the plugin architecture
  4. High availability, scalability
  5. Jenkins is emerging as the hub of continuous delivery
  6. Now let’s dig a little deeper into SOASTA Solutions. Running on our single platform, each set of capabilities are packaged to provide a complete set of quality tools for your teams to meet the needs of an increasingly continuous delivery cycle.