How to automate performance in DevOps

1. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
How to automate performance in DevOps
Vasilis Chatzinasios

2. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Why performance?
DevOps and Performance - Intro
Speed of delivery
Competitive
performance
Stability for peaks
Migration of
applications
Why DevOps?
Rate of Change

3. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach - Monolith
Planning Scripting Running Analysing

4. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach – Monolith & Microservices
Planning Scripting Running Analysing

5. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach - Microservices
Planning Scripting Running Analysing

6. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
The Challenge of performance in DevOps
Speed of DeliverySpeed of Performance How do you measure performance?

7. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
PERFORMANC
E
What is performance?

8. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Automated Analysis Workflow
Step 1
Step 2
Step 3
Step 4
Step 5
Metrics Framework
Identify Metrics Using a
service metrics framework
Threshold Comparison
Compare against thresholds
Baseline Comparison
Compare against the baseline
Pattern Analysis
Matching with expected
Patterns
Test Result
Rules Engine to give a
Pass/Fail

9. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Service Metrics Framework
Business Metrics Service Metrics Components Metrics

10. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Threshold Analysis
Does it pass the threshold?
How many times does it pass
the threshold?
How many metrics pass the
threshold?

11. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Baseline Comparison
Changes over last run
Change over last release
Trend over time
Response time increase
Garbage Collection Time increase
Processor Utilisation Increase
Running out of Memory

12. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Pattern Analysis

13. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Script Automation
Test Data
Test Scenario
Microservice Call – URL
Service Demand
• Have set Naming conventions
• Agree on Scenario Duration and type
• Input URL automation
• Know the demand from the planning phase
Script

14. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
How to reduce the false positives and ensure results
consistency
Process Tools Environment Data Reporting Roles & Responsibilities

15. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Integrated Performance Test
Endurance/Soak Test
Load Test
Stress Test
Spike Test
VirtualUsersVirtualUsers
VirtualUsersVirtualUsers
Time Time
TimeTime

16. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
?
Any Questions?
?????????