Kubernetes Monitoring & Best Practices

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Sumo Logic confidential
Kubernetes Monitoring &
Best Practices
1

Sumo Logic confidential
• Principal Development Engineer at DellEMC
• 1st half of my career was in CGI & VMware
• 2nd half...

Sumo Logic confidential
Suresh Govindachetty
• Enterprise Sales Engineer at Sumo Logic
• Formerly with Citrix, HPE,Nortel
...

Sumo Logic confidential
Massive shift in
monitoring
requirements from
host based
monitoring
to
“container-specific
& servi...

Sumo Logic confidential
Containers & Kubernetes: The New Reality
App
Traditional
Software
Architecture
Containerized
Archi...

Sumo Logic confidential
Traditional Monitoring Solution
Bare Metal
System
hypervisor
Virtual Machines Containers
Monitorin...

In a Monolithic World…
What to Monitor?
Application
Hosts on which the
applications gets deployed
7

In a Cloud Native World…
What to Monitor?
Hosts
Kubernetes
Platform
Docker Containers Containerized
Microservices
8

Sumo Logic confidential
Benefits of Containers & Kubernetes
Portability Scalability Rolling Updates Service Discovery Load...

Sumo Logic confidential
While Kubernetes solves old problems,
it introduces new ones.
10

Sumo Logic confidential
K8s is powerful…
but Complex !
Kubernetes
is great but
COMPLEX!
$kubectl create –f web.yaml
Curren...

Sumo Logic confidential
Current Challenges in Kubernetes Monitoring & Troubleshooting
K8s is powerful…
but Complex !
Every...

Sumo Logic confidential
Current Challenges in Kubernetes Monitoring & Troubleshooting
K8s is powerful…
but Complex !
Casca...

Sumo Logic confidential
Current Challenges in Kubernetes Monitoring & Troubleshooting
K8s is powerful…
but Complex !
More ...

Sumo Logic confidential
Methodology Switch
Cattle: (Container) Pet: (K8s Services)
o Named with strings of numbers
o Almos...

Sumo Logic confidential
Visualizing Kubernetes Objects
Service A
Namespace
Service B
Container
Pod C1
Pod C2
Pod C3
Servic...

Sumo Logic confidential
K8s Monitoring Strategies & Methods
- Remote Polling( K8s metric/event APIs)
- Node-based (agent p...

Sumo Logic confidential
K8s Metrics - Monitoring Kubernetes Cluster
Node resource utilization The number of nodes Running ...

Sumo Logic confidential
K8s Metrics - Monitoring Pod
Kubernetes Metrics Container Metrics Application Metrics
- Developed ...

Sumo Logic confidential
Node Metrics from node_exporter Container Metrics from cadvisor K8s Metrics from K8s API Server
- ...

Sumo Logic confidential
Source of Metrics in Kubernetes
k8s derived kube-state-metrics Etcd Metrics from etcd
- Counts & m...

Kubernetes Monitoring
Best Practices
22

Sumo Logic confidential
#1: Collect Metrics at Container Level but Alerts at Service
Level
$cat /etc/docker/daemon.json
{
...

Sumo Logic confidential
#2: Monitor Service Level Objective(SLO) per Service per Route
• Error Rate per Service per route
...

Sumo Logic confidential
#3: Infra Metrics: Utilization
- Resource Availability for Pods Vs Allocation
- Verify every Pod/C...

Sumo Logic confidential
#4: Always alert on High Disk Usage
26
• Monitor ALL disk volumes, including the root file system....

Sumo Logic confidential
#5: Never ignore Kube-system
27
• Total DNS Requests - Resource Issue, Scaling Limits, Application...

Sumo Logic confidential
#6: Consistent Metadata Enrichment
Tag individual components of Kubernetes so that it can provide ...

Sumo Logic confidential
Best Practice #6: No Better KPI than API - Track the API
Gateway for Microservices in order to
aut...

Sumo Logic confidential
Discoverability - Infrastructure vs. Service View
- Complex
- Slow to find and troubleshoot issues...

Sumologic K8s Monitoring and Troubleshooting
• Delivers a best in class, end-to-end Kubernetes Monitoring and Troubleshoot...

Sumo Logic confidential
Data Collection with Sumo Logic
32

Sumo Logic Confidential
Our Kubernetes Partner Apps - Security
App Purpose Details
SecOps Provides comprehensive monitorin...

Sumo Logic Confidential
Ecosystem - Unified K8s DevOps and SecOps
Monitoring
CI/CD DevOps SecOps
circleci
codefresh
armory...

Sumo Logic confidential
It’s Demo Time…
35

Sumo Logic Confidential
36

References
https://kubernetes.io/docs/tasks/debug-application-cluster/resource-usage-
monitoring/
https://www.sumologic.co...

Sumo Logic Confidential
Thank You
38

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

LinkedIn
Facebook
Twitter
Email

Replay

Top clipped slide

View on SlideShare

1 of 38 Ad

1 of 38 Ad