Pensiamo ai performance test solamente quando il sistema è in produzione e il danno è già fatto! In 45 minuti vedremo come sfruttare le potenzialità di Azure Pipelines per verificare costantemente durante lo sviluppo che le performance delle nostre applicazioni non degradino misurando le metriche esposte da un'applicazione AspNet Core

1. Monitoring e
performance testing
con Azure Pipelines
Giorgio Lasala
Solution Architect @Engineering

2. Thanks to

3. A real (recent) story

4. Continuous Performance Testing in a DevOps World
Tested ?SpaceX - CrewDragon

5. Blind automation

6. Monitored automation

7. Release Gate
Manual Approval
Automatic Gates

8. Health Status
Healthy
200 OK
"Everything is fine"
Degraded
200 OK
"Could be doing better
or about to become
unhealthy"
Unhealthy
503 Unavailable
"Not able to perform"

9. Health Check
ASP.NETCore application
/health
DefaultHealthCheckService
services
.AddHealthChecks()
.AddCheck("sync", () => … )
.AddAsyncCheck("async", async () => … )
.AddCheck<SqlConnectionHealthCheck>("SQL")
.AddCheck<UrlHealthCheck>("URL");

10. Azure DevOps Service health portal
https://status.dev.azure.com

11. Health Check Demo

12. HealthCheck Release Gate - Configuration

13. HealthCheck Release Gate - Execution

14. Quality metrics in DevOps Pipeline
➢ Health Check
✓ Response Time
✓ Error Rate - 4xx/5xx
✓ Hits / requests per second
✓ Request/Response Size
✓ Average throughput
✓ Request waiting
✓ Data sent / received
✓ Server CPU / memory

15. Health info and metrics
Health
Intrinsic knowledge of implementation
required
Logic to determine health is part of origin
Deployed together, good for autonomy
Metrics
Many individual measured values and counts
of events
Watch performance and trends
Useful for diagnostics and troubleshooting
Logic external to origin

16. Testing with K6
A developer centric open source load testing tool for testing
the performance of your backend infrastructure

17. Hello World… K6
Scenario configuration
Metrics & pass/fail criteria

18. Integration with tools

19. Performance Test Demo

20. Task K6 - Run

21. Task K6 - Results

22. Health check publishers
ASP.NET Core application
DefaultHealthCheckService
HealthCheckPublisher
HostedService
IHealthCheckPublisher
services.AddHealthChecks()
.AddInfluxDbPublisher(x => {
x.WriteApiUrl = "<URL>";
x.DatabaseName = "<DB_NAME>";
})
Publisher
Pushes out health info
periodically to other
sysstems

23. Grafana Analysis
Grafana
.NET Core app
HealthCheckPublisher
HostedServiceNotification
channel
▪ Slack
▪ Telegram
▪ …
K6 Metrics

24. Load Test Demo

25. Grafana Dashboard

26. Final Thoughts
Culture Change
• Not only Dev
• Not only Ops
• Not only Tester
Define Measures
• Metrics
• Quality Gate
Automate
• Shift Left
• Early Testing
• Performance
Analysis
• Continous
feedback loops
Integrate
• Azure DevOps
• Scripts
• 3rd party tools

28. Thank You!!!
www.linkedin.com/in/giorgiolasala
github.com/salem84
Solution Architect
@ Engineering
giorgio.lasala@eng.it

29. • Azure Pipeline Release deployment control using gates
https://docs.microsoft.com/en-
us/azure/devops/pipelines/release/approvals/gates?view=azure-devops
• HealthCheck Release Gate
https://marketplace.visualstudio.com/items?itemName=luisfraile.vss-services-
aspnetcorehealthcheck-extensions
• Collection of ASP.NET Core Health Check packages
https://github.com/Xabaril/AspNetCore.Diagnostics.HealthChecks
• K6 InfluxDB Grafana
https://k6.io/docs/results-visualization/influxdb-+-grafana
Links

30. Thanks to