Kube Your Enthusiasm

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

© Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Paul Czarkowski
pczarkowski@pivotal.io
Twitter: @pczarkowski
...

© Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Paul Czarkowski
pczarkowski@pivotal.io
Twitter: @pczarkowski
...

Cover w/ Image
Topics
■ Platforms
■ Containers
■ Kubernetes
■ Helm
■ Spinnaker
■ Operators
■ Pivotal Container Service
■ C...

Platforms

What is a platform ?
https://en.wikipedia.org/wiki/Computing_platform

Software runs on a
platform

Platforms abstract
complexity

Different platforms
abstract differently

Hardware
IaaS
CaaS
PaaS
FaaS
HPE, Dell,
IBM, Lenovo
AWS, Microsoft
Azure, GCP,
VMware
PKS, GKE,
OpenShift, AWS
Fargate, Ku...

A modern software
platform provides
API driven compute
resources.

API
Users
Storage Compute NetworkDatabase AccessArtifacts
Creative Commons
[1] Jon Trillana
[2] Simon Child
1 2

API
Users
Systems
Admin
Network
Engineer
SecurityDBA QA
Storage
Admin

Traditional
Ticket
Based
Human
Toil
IaaS
Hardware
Platform
PXE boot ?
15
More Control Less Control
Less Efficiency More Ef...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
Container Runtime
Container Hosts
Infrastructure
Platform
Infrastru...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
App → to the
Platform
Container Runtime
Container Hosts
PaaS
Applic...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
Build App
Container(s)
App → to the
Platform
Container Runtime
Cont...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
Build App
Container(s)
App → to the
Platform
Container Runtime
Cont...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
Build App
Container(s)
App → to the
Platform
Container Runtime
Cont...

Traditional
Ticket
Based
Human
Toil
Build App
Artifact
Build App
Container(s)
App → to the
Platform
Container Runtime
Cont...

Build App
Container(s)
CaaS
Container
Orchestrator
Pivotal
Container Service
Pivotal Cloud Foundry 2.0
More Control Less C...

APP
APP
APP
APP
Gitlab Concourse Spinnaker

Containers

Saurabh Gupta. "Containers and Pivotal Cloud Foundry" 2016.

FROM maven:3.6-jdk-11-slim as BUILD
COPY . /src
WORKDIR /src
RUN mvn install -DskipTests
FROM openjdk:11.0.1-jre-slim-stre...

$ docker build -t paulczar/hello .
$ docker push paulczar/hello
$ docker pull paulczar/hello
$ docker run -d -p 8080:8080 ...

Kubernetes

Hardware
IaaS
CaaS
PaaS
FaaS
Strategic goal: Push as many workloads as technically
feasible to the top of the platform hie...

Worker
Master
API
Server
Users
Control Plane
Data Plane
etcd
Cloud Ctrl
Manager
Kubelet
kube-proxy
docker
Scheduler
Contro...

Master
Master
Master
API
Server
Users
Control Plane
Data Plane
etcd
Cloud Ctrl
Manager
Worker
Kubelet
kube-proxy
docker
Sc...

Controllers

Desired State
Actual State

Unix Philosophy:
Do one thing. Do it well.

$ kubectl

Imperative
$ kubectl run hello
--image=paulczar/go-hello-world
$ kubectl scale hello
--replicas=3
$ kubectl create servi...

Declarative
$ kubectl apply -f hello-world.yaml

Declarative
Vs
Imperative

manifests

Imperative
apiVersion: v1
kind: Pod
metadata:
name: hello
spec:
containers:
- image: paulczar/go-hello-world
imagePullPoli...

Resources

● Pods
● Services
● Volumes

POD

one or more containers that share
a network and storage

the minimum scalable unit
of your application

MASTER
Node 1 Node 2 Node 3 Node 4
hello
kubelet kubelet kubelet kubelet
Scheduler
Pod
Name: hello
Image: hello1

MASTER
Node 1 Node 2 Node 3 Node 4
hello
kubelet kubelet kubelet kubelet
Scheduler
hello
Pod
Name: hello
Image: hello1

MASTER
Node 1 Node 2 Node 3 Node 4
hello
kubelet kubelet kubelet kubelet
Scheduler
Pod
Name: hello
Image: hello1

Replica Set

MASTER
Node 1 Node 2 Node 3 Node 4
hello-a
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Replica Set
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
hello-a
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Replica Set
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
hello-a
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Replica Set
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Replica Set
Name: hello
Im...

Deployment

MASTER
Node 1 Node 2 Node 3 Node 4
hello-A-c
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Deployment
Name:...

MASTER
Node 1 Node 2 Node 3 Node 4
hello-A-c
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Deployment
Name:...

MASTER
Node 1 Node 2 Node 3 Node 4
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
Deployment
Name: hello
Ima...

StatefulSet

MASTER
Node 1 Node 2 Node 3 Node 4
hello-1
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
StatefulSet
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
hello-1
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
StatefulSet
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
hello-1
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
StatefulSet
Name: ...

MASTER
Node 1 Node 2 Node 3 Node 4
db-1
kubelet kubelet kubelet kubelet
Scheduler
Controller
Manager
StatefulSet
Name: db
...

$ kubectl

$ kubectl run hello
--image=paulczar/hello
-- port=8080

● kubectl run created a deployment “deployments.apps/hello”
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
deployment.apps/...

$ kubectl scale --replicas=3
deployment/hello

$ kubectl scale --replicas=3 deployment/hello
deployment.extensions/hello scaled
$ kubectl get all
NAME READY STATUS RESTA...

$ kubectl edit deployment hello
...
spec:
containers:
- env:
- name: MESSAGE
value: HELLO I LOVE YOU!!!!
image: paulczar/g...

$ kubectl get all
NAME READY STATUS RESTARTS AGE
pod/hello-5c75b546c7-4lwnn 1/1 Running 0 1m
pod/hello-5c75b546c7-bwxxq 1/...

$ kubectl port-forward deployment/hello 8080
Forwarding from 127.0.0.1:8080 -> 8080
$ curl localhost:8080
<html><head><tit...

Service

$ kubectl expose deployment
hello --type=LoadBalancer
--port 80 --target-port 8080

kubectl expose deployment hello
● creates a service with a ClusterIP that acts as an internal loadbalancer to all
pods in ...

Service
track Pods based on metadata and provides
connectivity and service discovery (DNS, Env
variables) for them.
Type
C...

Service
track Pods based on metadata and provides
connectivity and service discovery (DNS, Env
variables) for them.
Type
N...

Service
track Pods based on metadata and provides
connectivity and service discovery (DNS, Env
variables) for them.
Type
L...

Ingress
a controller that manages an external entity to provide
load balancing, SSL termination and name-based
virtual hos...

Volume

Container
Container
Pod
Volume
Is [effectively] a Directory, possibly with data in it,
available to all containers in a Po...

Config Map / Secret

$ kubectl create configmap hello
--from-literal=’message=Hello S1T’

kubectl create configmap hello --from-file=index.html
● creates a configmap called “hello” containing the contents index.h...

kubectl create secret generic hello --from-file=index.html
● creates a secret called “hello” containing a base64 hash of c...

Provides key-value pairs to be injected into a pod much like user-data is injected into a Virtual
Machine in the cloud.
Al...

Helm

Helm is the best way to
find, share, and use
software built for Kubernetes
@pczarkowski

custom
load balancer
Chart.yaml
Values.yaml
templates/
ci
services
db

Discover & launch great
Kubernetes-ready apps
Search charts
231 charts ready to deploy
Wordpress, Jenkins, Kubeless...
Sec...

apiVersion: v1
kind: ConfigMap
metadata:
name: {{ .Chart.name }}-cm
data:
db: {{ .Value.db }}
apiVersion: apps/v1beta1
kin...

$ helm install --name staging .
--set db=’user:pass@staging.mysql/dbname’
$ helm install --name production .
--set db=’u...

$ helm create

Spinnaker

https://medium.com/netflix-techblog/announcing-ribbon-tying-the-netflix-mid
-tier-services-together-a89346910a62

https://giphy.com/gifs/frustrated-keyboard-g8GfH3i5F0hby
@pczarkowski

https://unsplash.com/photos/WHWYBmtn3_0
@pczarkowski

+
@pczarkowski

APP
APP
APP
APP
Gitlab Concourse Spinnaker
@pczarkowski

Cluster Management
● Server Group
● Cluster
● Applications
● Load Balancer
● Firewall
Pipelines
● Pipeline
● Stage
● Deplo...

Multi-Cloud Inventory
● Server Group
● Cluster
● Applications
● Load Balancer
● Firewall
Actions and Reactions
● Pipeline
...

@pczarkowski

Cluster Management
● Server Group
● Cluster
● Applications
● Load Balancer
● Firewall
Deployment Management
● Pipeline
● S...

Spinnaker
Cloud
API
App App App
@pczarkowski

@pczarkowski

Halyard
https://en.wikipedia.org/wiki/Halyard

@pczarkowski

Extending Kubernetes

Watchers
Watch the Kubernetes
API for changes to
resources and perform
arbitrary actions.

Watchers
Prometheus watches
Services and Pods for
certain annotations ...

Watchers
Spring Cloud Kubernetes
watches Services and Endpoints
to do service discovery on
kubernetes.

It also watches and reads
ConfigMaps to allow for dynamic
configuration of your
applications.

Dynamic Access Control
After a request is
authorized it goes
through Admission
Control

Dynamic Access Control
Image Policy Webhook

Dynamic Access Control
Admission Webhook

Dynamic Access Control
Initializers

Custom Controllers
Kubernetes functionality
is implemented using
controllers.

Custom Controllers
The External DNS
Controller

Custom Controllers
The Cert Manager
Controller

Operators

Operators
GCP Cloud Compute
Operator
https://github.com/paulczar/gcp-cloud-compute-operator

Operators
https://github.com/paulczar/gcp-cloud-compute-operator

Pivotal Container Service

> kubectl
Storage NetworkingCompute
Kubernetes Dashboard
Dev / Apps IT / Ops
App User
Kubernetes is a Runtime for Containe...

Storage NetworkingCompute
Dev / Apps
App User
IT / Ops
> kubectl
Kubernetes Dashboard
Load Balancing / Routing
Container I...

Storage NetworkingCompute
Pivotal Container Service (PKS) provides what’s missing
Dev / Apps
App User
IT / Ops
> kubectl
K...

Storage NetworkingCompute
Dev / Apps
App User
IT / Ops
> kubectl
Kubernetes Dashboard
Load Balancing / Routing
Container I...

Embedded OS
(Windows & Linux)
NSX-T
CPI (15 methods)
v1
v2
v3
...
CVEs
Product Updates
Java | .NET | NodeJS
Pivotal Applic...

BOSH
Reliable and consistent operational experience for any cloud.
BOSH
Harbor
NSX-T
Kubernetes
K8s Cluster
K8s Cluster
K8...

What PKS adds to Kubernetes
PKS
value-added
features
Built into
Kubernetes
Multi-container pods
Stateful Sets of pods
Pers...

PKS Vision
To provide enterprise customers with the ability to
safely and efficiently deliver container services
on their ...

PKS does for your Kubernetes
what
Kubernetes does for your apps

Operational
Efficiency
● Employ 500:1 developer
to operator ratio
● Perform zero-downtime
upgrades
● Runs the same way
on ...

Opsing the PKS

BOSH
Pivotal Container Service
Platform Ops
Pivotal
Ops Manager
PKS tile
upload
and config
Pivotal
Network
Install
Install...

PKSControlPlane
GCP
Service Broker
Harbor
BOSH
Pivotal Container Service
Platform Ops
deploy
Install
Pivotal
Ops Manager
I...

… or
...
Pivotal
NetworkConcourse
pipelinePlatform Ops
Execute
Verify pre-reqs
Provision
infrastructure
Download
binaries
...

PKS User Interaction
● The PKS Management VM runs the PKS API
together with the Broker, UAA and a MySQL DB.
●
● The PKS AP...

Creating a new K8s Cluster
Platform User
PKSControlPlane
CLI
API
PKS CREATE CLUSTER
BOSH
deploy
Kubernetes cluster
Create
...

Deploying a Kubernetes Cluster via PKS
BOSH
PKS CONTROL PLANE
PKS API
MySQL
PivotalOpsManager
Master / etcd
Worker 1
Worke...

Availability Zone B
Availability Zone A
Health Management and HA
(1) Kubelet watches and restart containers
Kubelet
Kube-p...

Multi-Tenancy
PKSControlPlane
Kubernetes cluster
Kubernetes cluster
Harbor
GCP SB
NSX-T
BOSH
Kubernetes cluster
Master
Wor...

Deployment Topologies & Multi-Tenancy
Multi-cluster Single cluster
K8s Cluster A
K8s Cluster
BOSH
Namespace A
Namespace B
...

Multiple Kubernetes clusters deployed and managed
independently by BOSH
Independent networks with independent policies.
Ea...

Scaling a Kubernetes Cluster
Platform User
PKSControlPlane
CLI
API
PKS SCALE CLUSTER
BOSH
deploy
Kubernetes cluster
Scale
...

A new security patch is released for Kubernetes.
Pivotal releases a new CVE for PKS within a few hours.
The Platform Opera...

BOSH
Pivotal Container Service
Platform Ops
Pivotal
Ops Manager
PKS tile
upload
and config
Pivotal
Network
Update
Platform...

PKSControlPlane
GCP
Service Broker
Harbor
BOSH
Pivotal Container Service
Platform Ops
deploy
Update
Pivotal
Ops Manager
Pl...

… or
...
Pivotal
NetworkConcourse
pipelinePlatform Ops
Execute
Verify pre-reqs
Verify current
install
Download
updated bin...

Ghost Clusters

Eat your own
Dog Food.

Identify Candidates for PKS
1

BUCKET 1
Independent Software Vendor (ISV) COTS
BUCKET 2
Middleware Vendor
BUCKET 3
.NET Core or .NET (Windows Server)
BUC...

TIME Methodology
TECHNICALQUALITY
BUSINESS VALUEWORSE BETTER
WORSEBETTER
Tolerate Invest
MigrateEliminate
* Gartner’s TIME...

TIME Methodology
TECHNICALQUALITY
BUSINESS VALUEWORSE BETTER
WORSEBETTER
Tolerate Invest
MigrateEliminate
* Gartner’s TIME...

Cloud Native Operations

Source: "It's All About Delivering: A Journey From AWS to Cloud Foundry,"
Daniel Basten, Talanx, s1p 2018.

Sources: "Sky is the Limit for Cloud Foundry at AirFrance-KLM," Nathan Wattimena & Fabien Lebrere, AirFrance-KLM, Oct. 201...

APP
APP
APP
APP
Gitlab Concourse Spinnaker

https://medium.com/netflix-techblog/how-we-build-code-at-netflix-c5d9bd727f15

APP
APP
APP
APP
Gitlab Concourse Spinnaker

APP
APP
APP
APP
Gitlab Concourse Spinnaker

You’re no longer an IT team

You’re a Platform Team

You’re a Product Team
The Platform is your product

Infra
Services
App
Platform
Change!!!
Platform
Team
Application
Team
Build common services
for App Teams
Take business
req...

Measure
AUTOMATE
Share
CULTURE
LEAN
LEAN

https://youtu.be/McV0Q5GY-fM

http://engineering.pivotal.io/post/transformation-roi/

Source: "Adopting PCF At An Automobile Manufacturer," Thomas Seibert and
Gregor Zurowski, s1p 2017.

PLATFORM VALUE STREAM AND METRICS
REPLATFORM > MODERNIZE > OPTIMIZE
ESTABLISH, MEASURE AND UPDATE
KEY OBJECTIVES AND RESUL...

Sample CIO Dashboard
60 Days
Avg Lead Time
500
Stories per week
10%
Apps on a CD
Pipeline to Prod
15ms
Avg Response Time
Y...

Transforming How The World Builds Software
© Copyright 2019 Pivotal Software, Inc. All rights Reserved.

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

Share
Email

ChatGPT and the Future of Work - Cl... by Clark Boyd 9424 views
Getting into the tech field. what n... by Tessa Mero 2384 views
Google's Just Not That Into You: Un... by Lily Ray 3774 views
How to have difficult conversations by Rajiv Jayarajah, ... 2378 views
Introduction to Data Science by Christy Abraham Joy 81737 views
Time Management & Productivity - B... by Vit Horky 169438 views

Top clipped slide

1 of 193 Ad

1 of 193 Ad