My talk at HighLoadStrategy, Lithuania, 2015 about Yandex.Tank, an open-source performance measurement tool that was born in the advertising technologies department at Yandex.

2. Yandex.Tank: a performance
measurement tool
Alexey Lavrenuke, HighLoadStrategy, 2015

3. Yandex.Tank
10 years of development
Full of features
Proven practical usefulness
3

4. Yandex.Tank
〉10 years of development
Full of features
Proven practical usefulness
4

5. A Story of a Programmer and his Creature
Phantom: a fast web-server
Coroutine-based
There was no tool to test it
5
shutterstock.com

6. The Beast Beats Itself
OK, why, let’s use phantom to test phantom
Phantom-benchmark was written
6
shutterstock.com

7. Phantom and Friends
Scripts in Bash and Perl to simplify
testers’ daily routine
Web-service that keeps the data
together
7
shutterstock.com

8. Tank grows big
Unified toolset for common tasks
Modular structure to be flexible and
extensible
Tank became a dedicated project
8
shutterstock.com

9. Yandex.Tank today
An open source project under
LGPL license
Mostly python, some js.
Default load gen is in C++
(external project)
9
shutterstock.com

10. Meta tool
Yandex.Tank is a meta tool
Tank: common workflow for
different load generators
Load gen: generate load and
measure response
characteristics accurately
10

11. Yandex.Tank
10 years of development
〉Full of features
Proven practical usefulness
11

12. Features list
Monitoring tool included
HTML reports with interactive charts
Auto stop your test on different conditions
High speed
Convenient configuration system
Extensibility
12

13. The fast, the furious
Phantom: 100 000 requests per
second
This is about 8 000 000 000
requests per day
13
shutterstock.com

14. Configure that
Configuration in .ini files
Good defaults and you can redefine them
Redefine on multiple levels
14
shutterstock.com

15. How to configure, load.ini
[phantom]
15
Add section header:

16. How to configure, load.ini
[phantom]
address = my.service.com
16
Add server’s address:

17. How to configure, load.ini
[phantom]
address = my.service.com
uris = /
/mypage.html
/my/query?param=1
headers = [Host: my.service.com]
[Connection: Keep-Alive]
17
Add URI list and HTTP headers:

18. How to configure, load.ini
[phantom]
address = my.service.com
uris = /
/mypage.html
/my/query?param=1
headers = [Host: my.service.com]
[Connection: Keep-Alive]
rps_schedule = line(1, 30000, 40s) const(30000, 5m)
18
Last one, the schedule. Put it all to ‘load.ini’:

19. Shoot it down!
yandex-tank -c ./load.ini
19
Save the file as load.ini and shoot:

21. 21
Percentiles and times
distribution for current
load level

22. 22
HTTP and network errors
for current load level

23. 23
Cumulative percentiles and
request/response average
sizes

24. 24
Progress, ETA and
metainfo

25. 25
Progress, ETA and
metainfo

26. How to configure, command line
26
yandex-tank -c ./load.ini -o
"phantom.rps_schedule=line(1, 30, 40s) const(30, 5m)"
Vary the load schedule by adding command line option:

27. How to configure defaults
27
〉Machine defaults at /etc/yandex-tank
〉User defaults at ~/.yandex-tank
[autostop]
autostop = http(4xx,25%,10)

28. Extensible
Open-source
Modular by design
Write a reader for custom log format
Write a wrapper for your favorite tool
28
shutterstock.com

29. A fun part =)
Drummers contest at an IT conference:
who makes more hits in a minute?
One hit = one request to the server
More then a hundred competitors in
one day
29

30. Yandex.Tank
10 years of development
Full of features
〉Proven practical usefulness
30

31. Why automate?
Humans are expensive
And robots are not
31*Bender, a character from Futurama
*

32. CI
Use Tank with Jenkins
HTTP API
One test — one click (or no clicks
at all)
32
lrp.it

33. Jenkins: tank startup script
Download ammo via scp, shoot with
parameters
33
scp srv1:/var/log/access.log ./
yandex-tank -c ./load.ini
-o"phantom.rps_schedule=const($rps, 10m)"

34. Reports
HTML, and you can change the template
Interactive JS-based graphics
Easy to share
34
shutterstock.com

35. 35

36. Yandex.Tank
10 years of development
Full of features
Proven practical usefulness
〉And one more thing…
36

37. Try it at home!
Install from PPA:
sudo add-apt-repository ppa:yandex-load/main
sudo apt-get update
sudo apt-get install yandex-load-tank-base
37
Use a Docker container with Yandex.Tank + TankAPI:
sudo docker run -d -p 8080:8888
"direvius/yandex-tank-api:v0.0.1"

38. shutterstock.com

39. Some useful links
About Yandex.Tank project: http://yandex.github.io/yandex-tank/
Yandex.Tank on github: https://github.com/yandex/yandex-tank
Yandex Tank API on github: https://github.com/yandex-load/yandex-tank-api
phantom on github: https://github.com/mamchits/phantom
Read the docs on ReadTheDocs: https://yandextank.readthedocs.org/
Ask questions in a gitter chat room: https://gitter.im/yandex/yandex-tank
My twitter is @direvius. Yandex.Tank’s tag is #yandextank
39

40. Thank you!
Alexey Lavrenuke, HighLoadStrategy, 2015
direvius@yandex.ru