1. #1 Load Testing
#2 Open Source lasting legacy
#3 Continuous Load Testing
#4 Let’s build one and scale it
RedLine13.com
(Almost) Free Load Testing
Richard Friedman
rich@redline13.com
@richardfriedman
@redlinethirteen

2. The Common Sense of Load Testing
• Everyone expects it to scale
• Always run a load test
• Start simple
• Model User Behavior
• Set realistic goals
• Load Tests expose issues, they don’t fix them

3. Performance and Throughput
Testing
Performance
ms
Load
per sec
Stress
redline
Soak
leaks
Find Bottleneck.
Performance Throughput

4. Build, [Run, Analyze, Fix]
Record
or
create
Play on
single
machine
Scale
on
single
agent
Run at
scale
tests
Analyze
Fix
Tweak
Configure
Scratch Head
Define Requirements
Build Test Environment

5. Load Testing is
Boring Tedious Detailed Precise
Then it becomes hard, time consuming, and frustrating
Fun Create Run Data
And at some point it becomes very rewarding, personally and for users.

6. Load Testing priority
After QA,
During Beta Launch When it falls
over
Continuous Investment in
Operations and
Development
Invest as needed

7. usergrinder
How it used to work?
Minions Start Your Test Plan
Servers
grindergrindergrindergrindergrindergrindergrindergrinder
grindergrindergrindergrindergrindergrindergrindergrindergrinder user

8. How it should work
Launch Test Plan
Servers
You

9. Analyzing with
Open Source Monitoring
Launch Test Plan
Monitoring & Logs
Production

10. Open Source Load Testing
And every script you ever wrote.
Tsung
Gatling
Seige
Tank
JMeter
clif
Yandex
locust
iago
The
Grinder
Twitter
10+
15+
12+
15+
14+
15+
4-5
2-3
3-4
1.60
7/2015
1.60
7/2015
2.17
7/2015
1.7.13
6/2015
2.13
3/2015
ab
httperf
2.2.1
10/2014
0.7.3
9/2014
0.6.14
2/2014
3.11
10/2012
GPL 2
GPL 3
LGPL 2.1
APACHE
LGPL 2
MIT
APACHE
BSD-STYLE
APACHE
X X X X X
X X X X X X
X X X
X X X X X X
X X X X X
X X
X ½ X ½
X X X X X X
python
java
java
c
erlang
java
scala
python
scala
15+
15+
2/2015
2/2011
APACHE
GPL 2
6/2015
distributed
recorder
charts
plugins
graphite
jenkins
X
BeesWithMG 3-4 MIT1/2013 python

11. Continuous Delivery
• Faster Iterations
• Master Location of data
• Performance Trend Lines
• Recorded Tests = Work Done
• Agile Development Process
• Unit Performance Tests

12. Why is it interesting?

13. Time Permitting
• Anyone want to build a test?
– Record JMeter Test
• (or hand build)
– Run Locally
– Scale Locally
– Scale in cloud

14. Thank You
RedLine13.com
(Almost) Free Load Testing
Richard Friedman
rich@redline13.com
@richardfriedman
@redlinethirteen