Continuous Performance Testing

What you are about to witness
Continious integration bla bla
What is hudson?
Performance Unit tests
Load testing with Jmeter
Load testing with Grinder

Continuous Integration?
Scheduled, automated build
Know of problems early on
Have a reasonably stable product at any time
Track various metric (tests, coverage, static code analysis, coding conventions)

Hudson CI
A breeze to install, simple to configure
Architecture:
Triggers (scheduling)
Hook to source control
Build tools (executable, ant, maven)
Report generators (test results)
Notifiers (email, RSS, etc.)
Other goodies: fingerprinting, distribution, ...

Continuous performance testing?
Track regressions in product performance
Meet specified performance requirements
Put guards for bugs resulting in errors threads
Establish a benchmark for the application
See (and show) progress

Performance Unit tests
Junit – not very much (timeout?)
Roll your own
Test decorators to help Threading, logging, more detailed requirements:
JUnitPerf (Junit 3.5 – decorate suits()
JUnitBench
ContiPerf

When to test units for performance?
Sanity tests
Performance critical units
Before making changes that might cause regressions
Note: Junit can be harnessed for sub-system tests, not just units

System tests
Try to emulate ”Real life” conditions: Test plan, deployment
Focus on finding out if something is wrong, not what
Check how to application as a whole is working
Build to scale when needed
Update the test as your application changes (example – cached responses)

JMeter
Tests are written in UI
Various samplers: Http, DB, java
Complicated tests are achived with different test plan elements, scripts, plugins
Distributed agents
Hudson plugin

Grinder
Generic and minimal ( == simple) approach
Jython (python) scripts based
Instrument tested code
Instrument your call
Http - out of the box support
Distributed test support via console

What we did not cover
Complex testing architecutre (distributed testing, multiple deployment targets)
Measuring server metrics (i.e. CPU, IO, Memory)
Micro performance testing – instrumented code, profiling

Amitay Dobo Http://www.doboism.com

Continuous Performance Testing

by Amitay Dobo on Nov 24, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 274

Statistics

Continuous Performance Testing — Presentation Transcript

http://www.doboism.com	273
http://webcache.googleusercontent.com	1