Distributed and Scalable JMeter
•
7 likes•1,341 views
Sharing load testing experiences and tools used at Hepsiburada Marketplace. This stack was used during Black Friday 2018 preparations.
More Related Content
What's hot
What's hot (20)
Similar to Distributed and Scalable JMeter
Similar to Distributed and Scalable JMeter (20)
Recently uploaded
Recently uploaded (20)
Distributed and Scalable JMeter
- 1. Marketplace Team Distributed & Scalable JMeter
- 2. TECHNOLOGY About Us Ganimet Yiğit ● Software QA Engineer with 2 years of experience ● Currently working in Hepsiburada Marketplace team https://www.linkedin.com/in/ganimet-yiğit ganimetyigit@gmail.com Can Soysal ● Software QA Engineer with 5 years of experience ● Currently working in Hepsiburada Marketplace team https://www.linkedin.com/in/can-soysal can.soysal@outlook.com.tr
- 3. TECHNOLOGY Agenda ➢What Started Us On This Journey? ➢What Have We Done ➢Preferred Tools ➢Scalable & Disposable JMeter ➢Demo ➢Pipeline as Code
- 4. TECHNOLOGY What Started Us On This Journey? ● Reach desired load for our tests ● Get rid of manual processes Pşb12:00 Pşb22:00 Cuma0:00 Cum a9:00 Cmts1:00 Total Visit Change in BF
- 5. TECHNOLOGY What Started Us On This Journey? ● Reach desired load for our tests ● Get rid of manual processes ● Monitor response time for short intervals ○ Detecting problems early ● Keep everything as code
- 6. TECHNOLOGY What Have We Done? System Under Test Slave Slave Slave Master LoadTest Swarm
- 9. TECHNOLOGY Feature JMeter K6 OS Any Any GUI Full No Test Recorder HTTP HTTP Test Language XML JavaScript Extension Language Java, Beanshell, Javascript, Jexl Javascript Load Reports CSV, XML, Embedded Tables, Graphs, Plugins JSON Host monitoring Yes with PerfMon plugin No Limitations Bundled reporting isn’t easy to interpret. Big data file read has problem Benchmarking
- 11. TECHNOLOGY Preferred Tools ● Jmeter ● InfluxDB InfluxDB is an open-source time series database developed by InfluxData. It is written in Go and optimized for fast, high-availability storage and retrieval of time series data in fields such as operations monitoring, application metrics, Internet of Things sensor data, and real-time analytics
- 12. TECHNOLOGY InfluxDB Alternatives Name InfluxDB Prometheus Description DBMS for storing time series, events and metrics Open-source Time Series DBMS and monitoring system License Open Source Open Source Implementation language Go Go Server operating systems Linux OS X Linux Windows Typing Numeric data and Strings Numeric data only In-memory capabilities yes no Data Model Custom-Tagset(key,valu e) Dashboard Support Yes Restricted
- 13. TECHNOLOGY How JMeter Sends Metrics To Influxdb ● Backend Listener The backend listener is an Asynchronous listener that enables you to plug custom implementations of Backend Listener Client.
- 14. TECHNOLOGY Preferred Tools ● Jmeter ● InfluxDB ● Grafana
- 15. TECHNOLOGY Preferred Tools ● Jmeter ● InfluxDB ● Grafana ● Docker Swarm Docker CLI A swarm is a group of machines that are running Docker and joined into a cluster.
- 16. TECHNOLOGY Preferred Tools ● Jmeter ● InfluxDB ● Grafana ● Docker Swarm ● Portainer Manage and Maintain Docker environments
- 17. Agenda ➢What Started Us On This Journey? ➢What Have We Done ➢What are Preferred Tools ➢Scalable & Disposable JMeter (And Now Here!) ➢ Infrastructure as Code ➢JMeter Master & Slave Configuration ➢InfluxDB Configuration ➢Grafana Configuration ➢Portainer Configuration ➢ Test Execution ➢Demo ➢Pipeline as Code TECHNOLOGY
- 18. TECHNOLOGY Docker CLI .yml file Docker Swarm Manager Node 1 JMeter Slave 1 Portainer Agent 1 Grafana 1 Portainer 1 Portainer Agent 1 JMeter Slave 1 Portainer Agent Scalable & Disposable JMeter 1xJmeter master X jmeter slave 1xGrafana 1xInfluxdb 1xPortainer X Portainer Agent 1JMeter Master 1 InfluxDB 1 Portainer Agent
- 19. TECHNOLOGY Scalable & Disposable JMeter Jmeter Master Node 192.168.0.1 Jmeter Slave Node 1 Jmeter Slave Node 2 Jmeter Slave Node n Target 192.168.0.2 192.168.0.3 192.168.0.n https://www.targetsystem.com Return Results Start Test Test Plan Request
- 20. TECHNOLOGY Scalable & Disposable JMeter JMeter Master Tasks: ● Define Test Plan ● Control slaves to start/stop test ● Collect Results from all slaves ● Write aggregated results to influxdb JMeter Slave Tasks: ● Execute test plan,generate traffic ● Send result back to master
- 21. TECHNOLOGY Jmeter Master and Slave Configurations Dockerfile https://hub.docker.com/r/vinsdocker/jmserver https://hub.docker.com/r/vinsdocker/jmmaster
- 22. TECHNOLOGY Jmeter Master and Slave Configurations docker-compose.yml
- 28. TECHNOLOGY Building Test Environment ● Deploying services ● After docker stack deploy
- 29. TECHNOLOGY Test Execution Via JMeter master console: Via Portainer ● Containers - > Service Name -> _console -> Connect
- 30. TECHNOLOGY Test Execution Without manual process:
- 32. TECHNOLOGY Agenda ➢What Started Us On This Journey? ➢What Have We Done ➢What are Preferred tools ➢Scalable & Disposable JMeter ➢Demo ➢Pipeline as Code
- 33. Pipeline as code ● Deployment pipeline through code instead of configuring a running CI/CD tool. ● Pipeline config is stored in VCS either with your application code or in a separate repository ● Pipeline config repos are referenced at GoCD TECHNOLOGY
- 34. TECHNOLOGY Pipeline as Code 1. InfluxDB a. Retag image and push to repository b. Deploying to test environment 2. Grafana a. Build image and push to repository b. Deploying to test environment 3. JMeter a. Build image and push to repository b. Run tests
- 35. TECHNOLOGY Pipeline as Code InfluxDB retag and push
- 36. TECHNOLOGY Pipeline as Code InfluxDB deploy to environment
- 37. TECHNOLOGY Pipeline as Code Grafana build image and push to repository
- 38. TECHNOLOGY Pipeline as Code Grafana build image and push to repository
- 39. TECHNOLOGY Jmeter Master and Slave Configurations Dockerfile https://hub.docker.com/r/vinsdocker/jmserver https://hub.docker.com/r/vinsdocker/jmmaster
- 40. TECHNOLOGY Pipeline as Code InfluxDB retag and push
- 41. TECHNOLOGY Pipeline as Code InfluxDB deploy to environment
- 42. TECHNOLOGY Pipeline as Code Grafana build image and push to repository
- 43. TECHNOLOGY Pipeline as Code Grafana build image and push to repository
- 44. TECHNOLOGY Pipeline as Code Grafana build image and push to repository
- 45. TECHNOLOGY Pipeline as Code Grafana deploy to environment
- 46. TECHNOLOGY Pipeline as Code JMeter build and push to repository
- 47. TECHNOLOGY Pipeline as Code JMeter build and push to repository Get jmeter image Define jmeter environment options Run build commands Setting needed plugins
- 48. TECHNOLOGY Pipeline as Code JMeter build and push to repository Define environment variables and entrypoint.sh
- 49. TECHNOLOGY Pipeline as code JMeter build and push to repository
- 50. TECHNOLOGY Pipeline as code JMeter run tests
- 51. 51