End to-end monitoring with the prometheus operator - Max Inden
•
4 likes•2,374 views
The document discusses end-to-end monitoring of containers using the Prometheus monitoring system and the Prometheus Operator. It describes what Prometheus and the Prometheus Operator are, how they can be used to monitor applications running in Kubernetes clusters, and how the Prometheus Operator automates management of Prometheus deployments. It also provides a demo of using the Kube-Prometheus project which bundles Prometheus, Alertmanager and dashboards into a single installation command.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to End to-end monitoring with the prometheus operator - Max Inden
Similar to End to-end monitoring with the prometheus operator - Max Inden (20)
More from Paris Container Day
More from Paris Container Day (10)
Recently uploaded
Recently uploaded (20)
End to-end monitoring with the prometheus operator - Max Inden
- 1. End-to-end Monitoring with the Prometheus Operator By @mxinden
- 2. Max Inden Test-Engineer at CoreOS @mxinden Max.Inden@CoreOS.com
- 3. Secure, simplify and automate container infrastructure
- 4. Secure, simplify and automate container infrastructure
- 5. Secure, simplify and automate container infrastructure
- 6. Secure, simplify and automate container infrastructure
- 11. What is Prometheus? ● Open Source Monitoring ● Built by Soundcloud ● Inspired by borgmon ●
- 12. What is Prometheus? ● Pull-based ●
- 13. What is Prometheus? ● Pull-based ● Multi-Dimensional ●
- 14. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ●
- 15. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ● No magic! ●
- 17. Target /metrics Target /metrics Target /metrics
- 18. Prometheus Target /metrics Target /metrics Target /metrics
- 19. Prometheus Target /metrics Target /metrics Target /metrics 15s
- 20. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8
- 21. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Metric name
- 22. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Label
- 23. Target /metrics # HELP http_requests_total Total number of HTTP requests made. # TYPE http_requests_total counter http_requests_total{code="200",path="/status"} 8 Value
- 24. Prometheus Target /metrics Target /metrics Target /metrics
- 25. Prometheus Target /metrics Target /metrics Target /metrics PromQL
- 26. Current percentage of HTTP errors across all service instances?
- 27. Current percentage of HTTP errors across all service instances? sum by(path) rate(http_requests_total{status="500"}[5m])) / sum by(path) rate(http_requests_total[5m]))
- 28. Current percentage of HTTP errors across all service instances? {path="/status"} 0.0039 {path="/"} 0.0011 {path="/api/v1/topics/:topic"} 0.087 {path="/api/v1/topics} 0.0342 sum by(path) rate(http_requests_total{status="500"}[5m])) / sum by(path) rate(http_requests_total[5m]))
- 29. Prometheus Target /metrics Target /metrics Target /metrics PromQL
- 30. Prometheus Target /metrics Target /metrics Target /metrics PromQL Web UI Dashboard
- 31. Prometheus Target /metrics Target /metrics Target /metrics
- 32. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition
- 33. ALERT DiskWillFillIn4Hours IF predict_linear(node_filesystem_free[1h], 4*3600) < 0 Is any disk about to run full within 4 hours? 0 now-1h +4h
- 34. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition
- 35. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition 1m
- 36. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition 1m
- 37. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition Alertmanager 1m
- 42. Prometheus Target /metrics Target /metrics Target /metrics Alertmanager
- 43. Prometheus Target /metrics Target /metrics Target /metrics Alertmanager
- 45. Monitoring
- 48. What is Kubernetes? Platform for running containerized applications
- 49. What is Kubernetes? Announced 2014 by Google Influenced by Borg & Omega v1.01 in July 2015 Kubernetes joins the CNCF
- 50. Master
- 62. Service Discovery ● Static target list ● DNS discovery ● Kubernetes discovery ● ...
- 65. Problem Prometheus is stateful and difficult to configure!
- 67. What is a K8s Operator?
- 68. What is a K8s Operator? Application specific operational knowledge
- 69. What is a K8s Operator?
- 70. What is a K8s Operator? </>
- 71. What is a K8s Operator? </>
- 72. What is a K8s Operator? </> Operator
- 74. Prometheus Operator ● Kubernetes native configuration ● Automated management and upgrades of Prometheus & Alertmanager
- 75. apiVersion: extensions/v1beta1 kind: Deployment metadata: name: my-app spec: ...
- 76. apiVersion: monitoring.coreos.com/v1alpha1 kind: Prometheus metadata: name: prometheus-k8s spec: ...
- 77. Kube-Prometheus Single command to install: ● Prometheus & Alertmanager Cluster ● Alerting rules ● Dashboarding
- 78. Demo
- 79. Recap
- 80. What is Prometheus? ● Pull-based ● Multi-Dimensional ● Metrics, not logging, not tracing ● No magic! ●
- 81. Prometheus Target /metrics Target /metrics Target /metrics 15s
- 82. Prometheus Target /metrics Target /metrics Target /metrics Alert Definition Alertmanager 1m
- 84. Where to go from here? Prometheus.io /coreos/prometheus-operator
- 85. San Francisco, New York & Berlin We are hiring!
- 86. Max Inden Test-Engineer at CoreOS @mxinden Max.Inden@CoreOS.com