CLIF meets Jenkins: performance testing in continuous integration, or more...Bruno Dillenseger, Orange Labs
Upcoming SlideShare
Loading in...5
×
 

CLIF meets Jenkins: performance testing in continuous integration, or more...Bruno Dillenseger, Orange Labs

on

  • 628 views

CLIF is OW2's load testing framework project, featuring outstanding adaptation capabilities. Among its possible integrations (such as Eclipse or Maven), this presentation focuses on CLIF's plug-in for ...

CLIF is OW2's load testing framework project, featuring outstanding adaptation capabilities. Among its possible integrations (such as Eclipse or Maven), this presentation focuses on CLIF's plug-in for the Jenkins Continuous Integration Server. This integration may be seen as a simple web-based user interface for running performance tests, enabling automatic testing and reporting. A demonstration and some use cases will be given, including the use of Jenkins' distributed mode for monitoring applications in complex network topologies.

Statistics

Views

Total Views
628
Views on SlideShare
621
Embed Views
7

Actions

Likes
2
Downloads
6
Comments
0

2 Embeds 7

http://clif.ow2.org 6
http://ow2.org 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

CLIF meets Jenkins: performance testing in continuous integration, or more...Bruno Dillenseger, Orange Labs CLIF meets Jenkins: performance testing in continuous integration, or more...Bruno Dillenseger, Orange Labs Presentation Transcript

  • CLIF meets Jenkins Performance testing in continuous integration, and more... Bruno Dillenseger - Orange Labs CLIF is OW2's load testing framework project, featuring outstanding adaptation capabilities. Among its possible integrations (such as Eclipse or Maven), this presentation focuses on CLIF's plug-in for the Jenkins Continuous Integration Server. This integration may be seen as a simple web-based user interface for running performance tests, enabling automatic testing and reporting. Beyond continuous integration, applications include monitoring applications quality of service in complex network topologies. www.ow2.org Twitter #ow2con 1
  • CLIF: OW2's load testing framework ● Tester's console generic/extensible IP, VoIP, database, mobile networks, custom protocols... ● flexible System Under Test Eclipse, Java Swing, command line, Maven, Jenkins ● advanced ● ● ● ● Millions of virtual users 1000+ distributed load injectors continuous research transfer Load injectors mature ● 10 years feedback http://clif.ow2.org www.ow2.org Twitter #ow2con 2
  • Jenkins continuous integration ● automated testing ● automated reporting ● ● ● per-test report trends through tests extensible by plug-ins ● http://jenkins-ci.org/ www.ow2.org the CLIF plug-in brings load testing and performance monitoring capabilities Twitter #ow2con 3
  • Using CLIF with Jenkins (1)   Define your CLIF test project (test plans and scenarios) with the usual Eclipse-based CLIF console Export as a .zip file www.ow2.org Twitter #ow2con 4
  • Using CLIF with Jenkins (2) 3 1 2 Import the .zip file in Jenkins (steps 1, 2) => a Jenkins job is automatically created for each test plan (step 3) www.ow2.org Twitter #ow2con 5
  • Using CLIF with Jenkins (3) 1A 1B   Run a test: manually (1A) or automatically (1B) Wait for test termination (2) www.ow2.org Twitter #ow2con 6
  • Using CLIF with Jenkins (4)  browse performance reports www.ow2.org Twitter #ow2con 7
  • Using CLIF with Jenkins (5)  observe performance trend through test runs www.ow2.org Twitter #ow2con 8
  • Using CLIF with Jenkins (6)  get raw measurements for custom analysis www.ow2.org Twitter #ow2con 9
  • Allocating distributed load injectors Remote CLIF load injection servers may be: ● ● ● ● references ● manually launched allocated from a community cloud ● allocated on a IaaS cloud... ...possibly along with the tested application ● Using Community Clouds for Load Testing: the ProActive CLIF solution. OW2Con '12 (Special Prize from OW2's Technical Committee) Load testing in continuous integration on a PaaS: see OpenCloudware project http://www.opencloudware.org Self-scalable Benchmarking as a Service with Automatic Saturation Detection. Middleware Conference 2013 (cooperation with LIG) www.ow2.org Twitter #ow2con 10
  • Using Jenkins' distributed mode for complex network topologies HTTP Jenkins master + CLIF plug-in Global Supervision ssh Jenkins slave A + CLIF runtime Jenkins slave B + CLIF runtime Health check of service platform A Health check of service platform B www.ow2.org Twitter #ow2con 11
  • Conclusion ● ● CLIF is mature, stable but lively ● On-going activities The Jenkins integration brings: ● ● ● ● ● a friendly web-based GUI for running CLIF tests automated test runs and advanced reports a suitable tool for monitoring platforms' quality of service ● ● www.ow2.org CLIF as a Service with multi-cloud load injection (OpenCloudware) Friendly User Test of load injection on users' desktops at Orange Labs cooperation with the ProActive team for advanced networking mavenization of code base to be completed Twitter #ow2con 12
  • ? clif@ow2.org www.ow2.org Twitter #ow2con 13