SlideShare a Scribd company logo
1 of 39
Download to read offline
OBSERVABILITY
DISTRIBUTED
COMPUTING
SERVICEMESH
KUBERNETES
ISTIO
ENVOY
EBRU CUCEN @ebrucucen#pwshsummit19
WHO AM I?
▸ Possibly the only Turkish, vegan
living in London, ex-.Net
developer, working in DevOps,
at Contino, proud-mum of 6-yo,
and prod-wife
▸ Loves exploring, learning,
sharing, inevitably communities!
▸ Ex-co-orgasinator of London
PowerShell User Group
@ebrucucen#pwshsummit19 02/05/2019
AGENDA
▸What? Definitions
▸When? Differences
▸Why? History - Demo I
▸How? Theory
▸How? Practice - Demo II
@ebrucucen#pwshsummit19 02/05/2019
MONITORING
▸ Collecting, processing, aggregating, and
displaying real-time quantitative data about a
system, such as query counts and types, error
counts and types, processing times, and
server lifetimes.[1]
@ebrucucen#pwshsummit19 02/05/2019
[1] Monitoring Distributed Systems, by Betsy Beyer, Rob Ewaschuk
TRADITIONAL SYSTEMS
Monitoring (Black box)
▸ Structured Log
▸ Well-defined Metrics
▸ Tracing
@ebrucucen#pwshsummit19 02/05/2019
TEXT
Audit Logs
Azure Tenant
Metrics
Application
Azure Subscription
Service Health
Activity Logs
Azure Resources
Diagnostic Logs
Monitoring Solutions
Guest OS
Application Insights
Dependency Agent
Log Analytics Agent
Diagnostics Extension
Azure
Custom API
Data Collector API
Non-Azure
Service Configuration
NOT ENOUGH!
TRADITIONAL SYSTEMS
Monitoring (Black box)
▸ Structured Log
▸ Well-defined Metrics
▸ Tracing
@ebrucucen#pwshsummit19 02/05/2019
TRADITIONAL SYSTEMS
Monitoring (Black box)
▸ Structured Log
▸ Well-defined Metrics
▸ Tracing
@ebrucucen#pwshsummit19 02/05/2019
Not Scalable
Up!=Working
May not be
complete
TEXT
▸ Latency
▸ Traffic
▸ Errors
▸ Saturation
FULLY CONNECTED NETWORKIMPROVED METRICS
https://landing.google.com/sre/sre-book/chapters/monitoring-distributed-systems/
Nines don’t matter if users aren’t happy
Charity Majors
@ebrucucen#pwshsummit19 02/05/2019
MODERN ERA
Black Box Monitor
▸ Checks
▸ Partial
▸ Passive/reactive
▸ No root cause
@ebrucucen#pwshsummit19 02/05/2019
MODERN ERA
White Box Monitor
▸ Discovery
▸ Whole
Black Box Monitor
▸ Checks
▸ Partial
▸ Passive/reactive
▸ No root cause
@ebrucucen#pwshsummit19 02/05/2019
TAXONOMY
Observability ?= Monitorability
@ebrucucen#pwshsummit19 02/05/2019
TAXONOMY
Observability ?= Monitorability
@ebrucucen#pwshsummit19 02/05/2019
OBSERVABILITY
▸ In control theory, observability is a
measure of how well internal states of a
system can be inferred from knowledge
of its external outputs[2]
@ebrucucen#pwshsummit19 02/05/2019
[2] Wikipedia, 1960, Rudolf Kalman
The goal of an observability team is not to
collect logs, metrics or traces. It is to build
a culture of engineering based on facts
and feedback, and then spread that
culture within the broader organization.
@ebrucucen#pwshsummit19 02/05/2019
Brian Knox (DigitalOcean)
OBSERVABILITY
8 FALLACIES OF DISTRIBUTED COMPUTING[3]
1. The network is reliable

2. Latency is zero

3. Bandwidth is infinite

4. The network is secure

5. Topology doesn't change

6. There is one administrator

7. Transport cost is zero

8. The network is homogeneous
@ebrucucen#pwshsummit19 02/05/2019
[3] L. Peter Deutsch,1994, James Gosling 1997
8 FALLACIES OF DISTRIBUTED COMPUTING[3]
1. The network is reliable

2. Latency is zero

3. Bandwidth is infinite

4. The network is secure

5. Topology doesn't change

6. There is one administrator

7. Transport cost is zero

8. The network is homogeneous
@ebrucucen#pwshsummit19 02/05/2019
[3] L. Peter Deutsch,1994, James Gosling 1997
‣ Manual restart

‣ Dropped packet

‣ Bottlenecks

‣ SSL/TLS?

‣ Cattle

‣ Conflicting rules

‣ I/O CPU

‣ Not anymore
HISTORY
VIRTUALISATIONTEAM ORCHESTRATION
2025 2026 2027 2028 20292020 2021 2022 2023 2024
Agile
Manifesto
DevOps
Microservices
Thoughtworks 

Microservices
Defined
XP
AWS
EC2
NETFLIX
to AWS
Docker
1999
Kubernetes
2001
2006
2009
2010 2012 2013
2014
2014
DEMO
PS: INVOLVES BALLOONS, MAYBE SOME EXPLOSIONS…
TEXT
▸ Namespace
▸ Pod
▸ Container
▸ Sidecar
CRYSTAL CLEAR?
NETFLIX - OSS- JAVAMICROSERVICES BEFORE SERVICE MESH
CONTAINER
RUNTIME C
SERVICE C
Load-balancer
Discovery
Resiliency
Metrics
Tracing
CONTAINER
RUNTIME A
SERVICE A
Load-balancer
Discovery
Resiliency
Metrics
Tracing
CONTAINER
RUNTIME B
SERVICE B
Load-balancer
Discovery
Resiliency
Metrics
Tracing
TEXT FULLY CONNECTED NETWORK
SERVICE
C
SERVICE
B
SERVICE
A
SERVICE
D
SERVICE
E
SERVICE
F
TEXT
Next logical step after a container orchestration deployment
- insight (observability), uniformly and ubiquitously
- connection
- control
- observability
- security
SERVICE MESH
The Enterprise Path to Service Mesh Architectures,Lee Calcote
NETWORK PLANES
POD A POD B
TEXT SIDECAR PATTERN
INGRESS EGRESS
SERVICE A SERVICE B
PROXY
SIDECAR
PROXY
SIDECAR
CONTROL PLANE
CONTAINER ORCHESTRATION
ISTIO NAMESPACE
TEXT ISTIO
CITADEL PILOT MIXER
SERVICE
FOO
BAR POD
SIDECAR PROXY
FOO CONTAINER
SERVICE
FOO
FOO POD
SIDECAR PROXY
FOO CONTAINER
Discovery & config
tls certs Telemetry Reports Policy Checks
TEXT DEMO
TEXT GOAL: BOOKINFO APP
TEXT BACKUP PLAN
screenshots
TEXT
▸ Install helm client
▸ Install helm Tiller server (RBAC)
$ brew install kubernetes-helm
$ kubectl apply -f install/kubernetes/helm/helm-service-account.yaml
$ helm init --service-account tiller
$ kubectl get pods --namespace kube-system
NAME READY STATUS RESTARTS AGE
coredns-79c89b8f4-2x2bv 1/1 Running 0 18h
coredns-79c89b8f4-jfnzm 1/1 Running 0 37h
coredns-autoscaler-6fcdb7d64-d7f2z 1/1 Running 0 37h
heapster-7677c744b8-s725f 2/2 Running 0 37h
kube-proxy-6gtrf 1/1 Running 0 37h
kube-svc-redirect-2w8tx 2/2 Running 0 37h
kubernetes-dashboard-6dffbcc8b9-hljr7 1/1 Running 2 37h
metrics-server-7b97f9cd9-p9wx8 1/1 Running 0 37h
omsagent-9vr56 1/1 Running 0 37h
omsagent-rs-69ccb9cc4c-n59qp 1/1 Running 1 37h
tiller-deploy-7b65c7bff9-kndx7 1/1 Running 0 18h
tunnelfront-c665446bf-d29vn 1/1 Running 0 37h
TILLER SERVICE ACCOUNT
az aks browse --resource-group demo-rg --name democluster
TEXT
TEXT
▸ Install helm charts istio-init and istio for istio-system
namespace
$ helm install install/kubernetes/helm/istio --name istio --namespace istio-system 
--set global.controlPlaneSecurityEnabled=true 
--set mixer.adapters.useAdapterCRDs=false 
--set grafana.enabled=true --set grafana.security.enabled=true 
--set tracing.enabled=true 
--set kiali.enabled=true
$ helm install install/kubernetes/helm/istio-init --name istio-init --namespace istio-system
ISTIO-SYSTEM NAMESPACE
$ kubectl get jobs -n istio-system
NAME COMPLETIONS DURATION AGE
istio-init-crd-10 1/1 16s 33h
istio-init-crd-11 1/1 15s 33h
TEXT ISTIO-SYSTEM
TEXT ISTIO-SYSTEM
TEXT ISTIO-SYSTEM
TEXT
TEXT
8 Fallacies
https://dzone.com/articles/understanding-the-8-fallacies-of-distributed-syste
Kubectl
https://kubernetes.io/docs/reference/kubectl/cheatsheet/#deleting-resources
The Enterprise Path to Service Mesh Architectures,Lee Calcote
https://landing.google.com/sre/sre-book/chapters/monitoring-distributed-systems/
REFERENCES

More Related Content

Similar to Observability

Cloud computing for libraries an introduction
Cloud computing for libraries an introductionCloud computing for libraries an introduction
Cloud computing for libraries an introductionKrista Godfrey
 
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Henning Jacobs
 
High Performance Cooperative Distributed Systems in Adtech
High Performance Cooperative Distributed Systems in AdtechHigh Performance Cooperative Distributed Systems in Adtech
High Performance Cooperative Distributed Systems in AdtechC4Media
 
Sqrrl February Webinar: Breaking Down Data Silos
Sqrrl February Webinar: Breaking Down Data SilosSqrrl February Webinar: Breaking Down Data Silos
Sqrrl February Webinar: Breaking Down Data SilosSqrrl
 
Need to-know patterns building microservices - java one
Need to-know patterns building microservices - java oneNeed to-know patterns building microservices - java one
Need to-know patterns building microservices - java oneVincent Kok
 
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)bridgetkromhout
 
IRJET- Analysis of Forensics Tools in Cloud Environment
IRJET-  	  Analysis of Forensics Tools in Cloud EnvironmentIRJET-  	  Analysis of Forensics Tools in Cloud Environment
IRJET- Analysis of Forensics Tools in Cloud EnvironmentIRJET Journal
 
Kubernetes + Python = ❤ - Cloud Native Prague
Kubernetes + Python = ❤ - Cloud Native PragueKubernetes + Python = ❤ - Cloud Native Prague
Kubernetes + Python = ❤ - Cloud Native PragueHenning Jacobs
 
Kubernetes Operability Tooling (GOTO Chicago 2019)
Kubernetes Operability Tooling (GOTO Chicago 2019)Kubernetes Operability Tooling (GOTO Chicago 2019)
Kubernetes Operability Tooling (GOTO Chicago 2019)bridgetkromhout
 
Continuous delivery for databases
Continuous delivery for databasesContinuous delivery for databases
Continuous delivery for databasesDevOpsGroup
 
Why I love Kubernetes Failure Stories and you should too - GOTO Berlin
Why I love Kubernetes Failure Stories and you should too - GOTO BerlinWhy I love Kubernetes Failure Stories and you should too - GOTO Berlin
Why I love Kubernetes Failure Stories and you should too - GOTO BerlinHenning Jacobs
 
Understanding Kubernetes
Understanding KubernetesUnderstanding Kubernetes
Understanding KubernetesTu Pham
 
Webinar–Vulnerabilities in Containerised Production Environments
Webinar–Vulnerabilities in Containerised Production EnvironmentsWebinar–Vulnerabilities in Containerised Production Environments
Webinar–Vulnerabilities in Containerised Production EnvironmentsSynopsys Software Integrity Group
 
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...NETWAYS
 
IRJET- Secure Database Management and Privacy Preserving in Cloud Server
IRJET- Secure Database Management and Privacy Preserving in Cloud ServerIRJET- Secure Database Management and Privacy Preserving in Cloud Server
IRJET- Secure Database Management and Privacy Preserving in Cloud ServerIRJET Journal
 

Similar to Observability (20)

Cloud computing for libraries an introduction
Cloud computing for libraries an introductionCloud computing for libraries an introduction
Cloud computing for libraries an introduction
 
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
 
High Performance Cooperative Distributed Systems in Adtech
High Performance Cooperative Distributed Systems in AdtechHigh Performance Cooperative Distributed Systems in Adtech
High Performance Cooperative Distributed Systems in Adtech
 
Sqrrl February Webinar: Breaking Down Data Silos
Sqrrl February Webinar: Breaking Down Data SilosSqrrl February Webinar: Breaking Down Data Silos
Sqrrl February Webinar: Breaking Down Data Silos
 
Need to-know patterns building microservices - java one
Need to-know patterns building microservices - java oneNeed to-know patterns building microservices - java one
Need to-know patterns building microservices - java one
 
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)
Join Our Party: The Cloud Native Adventure Brigade (TCSW 2019)
 
IRJET- Analysis of Forensics Tools in Cloud Environment
IRJET-  	  Analysis of Forensics Tools in Cloud EnvironmentIRJET-  	  Analysis of Forensics Tools in Cloud Environment
IRJET- Analysis of Forensics Tools in Cloud Environment
 
Kubernetes + Python = ❤ - Cloud Native Prague
Kubernetes + Python = ❤ - Cloud Native PragueKubernetes + Python = ❤ - Cloud Native Prague
Kubernetes + Python = ❤ - Cloud Native Prague
 
Natively clouded Journey
Natively clouded JourneyNatively clouded Journey
Natively clouded Journey
 
Compliance As Code
Compliance As CodeCompliance As Code
Compliance As Code
 
Kubernetes Operability Tooling (GOTO Chicago 2019)
Kubernetes Operability Tooling (GOTO Chicago 2019)Kubernetes Operability Tooling (GOTO Chicago 2019)
Kubernetes Operability Tooling (GOTO Chicago 2019)
 
Continuous delivery for databases
Continuous delivery for databasesContinuous delivery for databases
Continuous delivery for databases
 
Javantura v6 - Istio Service Mesh - The magic between your microservices - Ma...
Javantura v6 - Istio Service Mesh - The magic between your microservices - Ma...Javantura v6 - Istio Service Mesh - The magic between your microservices - Ma...
Javantura v6 - Istio Service Mesh - The magic between your microservices - Ma...
 
Kumar cscl final
Kumar cscl finalKumar cscl final
Kumar cscl final
 
Why I love Kubernetes Failure Stories and you should too - GOTO Berlin
Why I love Kubernetes Failure Stories and you should too - GOTO BerlinWhy I love Kubernetes Failure Stories and you should too - GOTO Berlin
Why I love Kubernetes Failure Stories and you should too - GOTO Berlin
 
Understanding Kubernetes
Understanding KubernetesUnderstanding Kubernetes
Understanding Kubernetes
 
Webinar–Vulnerabilities in Containerised Production Environments
Webinar–Vulnerabilities in Containerised Production EnvironmentsWebinar–Vulnerabilities in Containerised Production Environments
Webinar–Vulnerabilities in Containerised Production Environments
 
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...
stackconf 2020 | The blinking cursor or kubernetes for people who aren´t supp...
 
Seminor Documentation
Seminor DocumentationSeminor Documentation
Seminor Documentation
 
IRJET- Secure Database Management and Privacy Preserving in Cloud Server
IRJET- Secure Database Management and Privacy Preserving in Cloud ServerIRJET- Secure Database Management and Privacy Preserving in Cloud Server
IRJET- Secure Database Management and Privacy Preserving in Cloud Server
 

More from Ebru Cucen Çüçen

Evolution of Graph Algorithms – Benefits and Challenges
Evolution of Graph Algorithms – Benefits and ChallengesEvolution of Graph Algorithms – Benefits and Challenges
Evolution of Graph Algorithms – Benefits and ChallengesEbru Cucen Çüçen
 
How to Decentralise Controls (Hint: BDD on Policies)
How to Decentralise Controls (Hint: BDD on Policies)How to Decentralise Controls (Hint: BDD on Policies)
How to Decentralise Controls (Hint: BDD on Policies)Ebru Cucen Çüçen
 
Ebru cucen cloudnativeconference_20190925
Ebru cucen cloudnativeconference_20190925Ebru cucen cloudnativeconference_20190925
Ebru cucen cloudnativeconference_20190925Ebru Cucen Çüçen
 
Automating AWS And Azure Resources with Octopus Deploy
Automating AWS And Azure Resources with Octopus DeployAutomating AWS And Azure Resources with Octopus Deploy
Automating AWS And Azure Resources with Octopus DeployEbru Cucen Çüçen
 
CI/CD Pipeline with Octopus Deploy
CI/CD Pipeline with Octopus DeployCI/CD Pipeline with Octopus Deploy
CI/CD Pipeline with Octopus DeployEbru Cucen Çüçen
 

More from Ebru Cucen Çüçen (9)

Evolution of Graph Algorithms – Benefits and Challenges
Evolution of Graph Algorithms – Benefits and ChallengesEvolution of Graph Algorithms – Benefits and Challenges
Evolution of Graph Algorithms – Benefits and Challenges
 
How to Decentralise Controls (Hint: BDD on Policies)
How to Decentralise Controls (Hint: BDD on Policies)How to Decentralise Controls (Hint: BDD on Policies)
How to Decentralise Controls (Hint: BDD on Policies)
 
Observability
ObservabilityObservability
Observability
 
Ebru cucen cloudnativeconference_20190925
Ebru cucen cloudnativeconference_20190925Ebru cucen cloudnativeconference_20190925
Ebru cucen cloudnativeconference_20190925
 
GCP - 101
GCP - 101GCP - 101
GCP - 101
 
DevOps
DevOpsDevOps
DevOps
 
Automating AWS And Azure Resources with Octopus Deploy
Automating AWS And Azure Resources with Octopus DeployAutomating AWS And Azure Resources with Octopus Deploy
Automating AWS And Azure Resources with Octopus Deploy
 
CI/CD Pipeline with Octopus Deploy
CI/CD Pipeline with Octopus DeployCI/CD Pipeline with Octopus Deploy
CI/CD Pipeline with Octopus Deploy
 
Azure WebApp Deployment Slots
Azure WebApp Deployment Slots Azure WebApp Deployment Slots
Azure WebApp Deployment Slots
 

Recently uploaded

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 

Recently uploaded (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 

Observability

  • 2. WHO AM I? ▸ Possibly the only Turkish, vegan living in London, ex-.Net developer, working in DevOps, at Contino, proud-mum of 6-yo, and prod-wife ▸ Loves exploring, learning, sharing, inevitably communities! ▸ Ex-co-orgasinator of London PowerShell User Group @ebrucucen#pwshsummit19 02/05/2019
  • 3. AGENDA ▸What? Definitions ▸When? Differences ▸Why? History - Demo I ▸How? Theory ▸How? Practice - Demo II @ebrucucen#pwshsummit19 02/05/2019
  • 4. MONITORING ▸ Collecting, processing, aggregating, and displaying real-time quantitative data about a system, such as query counts and types, error counts and types, processing times, and server lifetimes.[1] @ebrucucen#pwshsummit19 02/05/2019 [1] Monitoring Distributed Systems, by Betsy Beyer, Rob Ewaschuk
  • 5. TRADITIONAL SYSTEMS Monitoring (Black box) ▸ Structured Log ▸ Well-defined Metrics ▸ Tracing @ebrucucen#pwshsummit19 02/05/2019
  • 6. TEXT Audit Logs Azure Tenant Metrics Application Azure Subscription Service Health Activity Logs Azure Resources Diagnostic Logs Monitoring Solutions Guest OS Application Insights Dependency Agent Log Analytics Agent Diagnostics Extension Azure Custom API Data Collector API Non-Azure Service Configuration NOT ENOUGH!
  • 7. TRADITIONAL SYSTEMS Monitoring (Black box) ▸ Structured Log ▸ Well-defined Metrics ▸ Tracing @ebrucucen#pwshsummit19 02/05/2019
  • 8. TRADITIONAL SYSTEMS Monitoring (Black box) ▸ Structured Log ▸ Well-defined Metrics ▸ Tracing @ebrucucen#pwshsummit19 02/05/2019 Not Scalable Up!=Working May not be complete
  • 9. TEXT ▸ Latency ▸ Traffic ▸ Errors ▸ Saturation FULLY CONNECTED NETWORKIMPROVED METRICS https://landing.google.com/sre/sre-book/chapters/monitoring-distributed-systems/
  • 10. Nines don’t matter if users aren’t happy Charity Majors @ebrucucen#pwshsummit19 02/05/2019
  • 11. MODERN ERA Black Box Monitor ▸ Checks ▸ Partial ▸ Passive/reactive ▸ No root cause @ebrucucen#pwshsummit19 02/05/2019
  • 12. MODERN ERA White Box Monitor ▸ Discovery ▸ Whole Black Box Monitor ▸ Checks ▸ Partial ▸ Passive/reactive ▸ No root cause @ebrucucen#pwshsummit19 02/05/2019
  • 15. OBSERVABILITY ▸ In control theory, observability is a measure of how well internal states of a system can be inferred from knowledge of its external outputs[2] @ebrucucen#pwshsummit19 02/05/2019 [2] Wikipedia, 1960, Rudolf Kalman
  • 16. The goal of an observability team is not to collect logs, metrics or traces. It is to build a culture of engineering based on facts and feedback, and then spread that culture within the broader organization. @ebrucucen#pwshsummit19 02/05/2019 Brian Knox (DigitalOcean) OBSERVABILITY
  • 17. 8 FALLACIES OF DISTRIBUTED COMPUTING[3] 1. The network is reliable 2. Latency is zero 3. Bandwidth is infinite 4. The network is secure 5. Topology doesn't change 6. There is one administrator 7. Transport cost is zero 8. The network is homogeneous @ebrucucen#pwshsummit19 02/05/2019 [3] L. Peter Deutsch,1994, James Gosling 1997
  • 18. 8 FALLACIES OF DISTRIBUTED COMPUTING[3] 1. The network is reliable 2. Latency is zero 3. Bandwidth is infinite 4. The network is secure 5. Topology doesn't change 6. There is one administrator 7. Transport cost is zero 8. The network is homogeneous @ebrucucen#pwshsummit19 02/05/2019 [3] L. Peter Deutsch,1994, James Gosling 1997 ‣ Manual restart ‣ Dropped packet ‣ Bottlenecks ‣ SSL/TLS? ‣ Cattle ‣ Conflicting rules ‣ I/O CPU ‣ Not anymore
  • 19. HISTORY VIRTUALISATIONTEAM ORCHESTRATION 2025 2026 2027 2028 20292020 2021 2022 2023 2024 Agile Manifesto DevOps Microservices Thoughtworks 
 Microservices Defined XP AWS EC2 NETFLIX to AWS Docker 1999 Kubernetes 2001 2006 2009 2010 2012 2013 2014 2014
  • 20. DEMO PS: INVOLVES BALLOONS, MAYBE SOME EXPLOSIONS…
  • 21. TEXT ▸ Namespace ▸ Pod ▸ Container ▸ Sidecar CRYSTAL CLEAR?
  • 22. NETFLIX - OSS- JAVAMICROSERVICES BEFORE SERVICE MESH CONTAINER RUNTIME C SERVICE C Load-balancer Discovery Resiliency Metrics Tracing CONTAINER RUNTIME A SERVICE A Load-balancer Discovery Resiliency Metrics Tracing CONTAINER RUNTIME B SERVICE B Load-balancer Discovery Resiliency Metrics Tracing
  • 23. TEXT FULLY CONNECTED NETWORK SERVICE C SERVICE B SERVICE A SERVICE D SERVICE E SERVICE F
  • 24. TEXT Next logical step after a container orchestration deployment - insight (observability), uniformly and ubiquitously - connection - control - observability - security SERVICE MESH
  • 25. The Enterprise Path to Service Mesh Architectures,Lee Calcote NETWORK PLANES
  • 26. POD A POD B TEXT SIDECAR PATTERN INGRESS EGRESS SERVICE A SERVICE B PROXY SIDECAR PROXY SIDECAR CONTROL PLANE CONTAINER ORCHESTRATION
  • 27. ISTIO NAMESPACE TEXT ISTIO CITADEL PILOT MIXER SERVICE FOO BAR POD SIDECAR PROXY FOO CONTAINER SERVICE FOO FOO POD SIDECAR PROXY FOO CONTAINER Discovery & config tls certs Telemetry Reports Policy Checks
  • 31. TEXT ▸ Install helm client ▸ Install helm Tiller server (RBAC) $ brew install kubernetes-helm $ kubectl apply -f install/kubernetes/helm/helm-service-account.yaml $ helm init --service-account tiller $ kubectl get pods --namespace kube-system NAME READY STATUS RESTARTS AGE coredns-79c89b8f4-2x2bv 1/1 Running 0 18h coredns-79c89b8f4-jfnzm 1/1 Running 0 37h coredns-autoscaler-6fcdb7d64-d7f2z 1/1 Running 0 37h heapster-7677c744b8-s725f 2/2 Running 0 37h kube-proxy-6gtrf 1/1 Running 0 37h kube-svc-redirect-2w8tx 2/2 Running 0 37h kubernetes-dashboard-6dffbcc8b9-hljr7 1/1 Running 2 37h metrics-server-7b97f9cd9-p9wx8 1/1 Running 0 37h omsagent-9vr56 1/1 Running 0 37h omsagent-rs-69ccb9cc4c-n59qp 1/1 Running 1 37h tiller-deploy-7b65c7bff9-kndx7 1/1 Running 0 18h tunnelfront-c665446bf-d29vn 1/1 Running 0 37h TILLER SERVICE ACCOUNT
  • 32. az aks browse --resource-group demo-rg --name democluster
  • 33. TEXT
  • 34. TEXT ▸ Install helm charts istio-init and istio for istio-system namespace $ helm install install/kubernetes/helm/istio --name istio --namespace istio-system --set global.controlPlaneSecurityEnabled=true --set mixer.adapters.useAdapterCRDs=false --set grafana.enabled=true --set grafana.security.enabled=true --set tracing.enabled=true --set kiali.enabled=true $ helm install install/kubernetes/helm/istio-init --name istio-init --namespace istio-system ISTIO-SYSTEM NAMESPACE $ kubectl get jobs -n istio-system NAME COMPLETIONS DURATION AGE istio-init-crd-10 1/1 16s 33h istio-init-crd-11 1/1 15s 33h
  • 38. TEXT
  • 39. TEXT 8 Fallacies https://dzone.com/articles/understanding-the-8-fallacies-of-distributed-syste Kubectl https://kubernetes.io/docs/reference/kubectl/cheatsheet/#deleting-resources The Enterprise Path to Service Mesh Architectures,Lee Calcote https://landing.google.com/sre/sre-book/chapters/monitoring-distributed-systems/ REFERENCES