This document discusses Kubernetes and related technologies like Kubespray, Kops, and Kube-aws for deploying and managing containerized applications on infrastructure. It also describes Project Kubo for deploying Kubernetes on BOSH and mentions Cloud Foundry as a platform for applications. Key technologies discussed include BOSH, stemcells, releases, and deployments for infrastructure automation.

1. Kubernetes

2. Pivotal Japan - Platform Architect
Kazuto Kusama
@jacopen

5. k8s

6. k8s
kubespray
kops
kube-aws

7. VM VM VM VM
IaaS

8. VM VM VM VM

9. VM VM VM VM
VM

10. VM VM VM VM
IaaS

11. Day 1 & Day 2
Day 2
•
•
•
•
•
Day 1
•

12. Day 1 & Day 2
Day 2
•
•
•
•
•
Day 1
•

14. Cloud Foundry 5

15. • Cloud Application Platform
• PaaS

16. • Cloud Application Platform
• PaaS
•
(AWS, Azure, GCP, vSphere,
OpenStack)
•

20. •
• Cloud Foundry
• Cloud Foundry
• Concourse CI, Prometheus BOSH

21. •
• Cloud Foundry
• Cloud Foundry
• Concourse CI, Prometheus BOSH

22. Project Kubo
• BOSH Kubernetes
Pivotal&Google
• 2017 2
• 2017 6 Cloud Foundry
Foundation
“Day 1” Build
•
•
“Day 2” Operate
•
•
•
Kubernetes BOSH
+

23. “A gift from the Cloud Foundry community.”
Sam Ramji, VP of product management for GCP

24. Kubo

25. Kubo

26. =
=

27. demo

30. Cloud Foundry VM
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...

31. VM
VM
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image

32. VM
VM
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
AWS AMI
OpenStack
Glance image

33. BOSH Stemcell
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
AWS AMI
OpenStack
Glance image
Stemcell

34. VM
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell

35. VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell
VM
bundle install pip install
apt-get upgrade OS

36. VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell
VM
bundle install pip install
apt-get upgrade OS

37. BOSH
Release
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell
VM
Release

38. Stemcell VM VM
Release yaml
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell
Release

39. BOSH
yaml deployment
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
VM
image
Stemcell
Release
deployment
Infrastructure as code

40. OS
Stemcell VM
VM VM VM VM
Cloud
Controller
UAA
garden-
runc
garden-
runc
... ... ... ...
old
Stemcell
Release
NEW
Stemcell
Immutable Infrastructure

41. Stemcell, Release, Deployment 3
Immutable Infrastructure Infrastructure as Code
BOSH
Stemcell Release Deployment

42. CPI (Cloud Provider Interface)
AWS CPI GCP CPI Azure CPI vSphere CPI OpenSatck CPI

43. health monitoring

44. VM monit
VM VM VM VM
monit monit monit monit

45. VM bosh-agent
VM VM VM VM
agent monit agent monit agent monit agent monit
Messaging bus (NATS)

46. VM BOSH
VM VM VM VM
agent monit agent monit agent monit agent monit
Messaging bus (NATS)

47. VM (Resurrector )
VM VM VM
agent monit agent monit agent monit
Messaging bus (NATS)
VM
agent monit

49. Stemcell Release Deployment
AWS CPI GCP CPI Azure CPI vSphere CPI
OpenSatck
CPI
VM VM VM
agen
t
moni
t
agen
t
moni
t
agen
t
moni
t
Messaging bus (NATS)
VM
agen
t
moni
t

50. ?

51. Borg
Google Borg

52. • Go!
• https://docs-cfcr.cfapps.io/
• v0.9.0
• GCP, AWS, vSphere, OpenStack

55. A turnkey solution to provision, operate and manage
enterprise grade Kubernetes clusters
+
+

56. BOSH
VMware GCP Azure Openstack AWS
Container
Registry
Kubernetes on BOSH (Kubo/CFCR)
NSX-T
GCP
Service
Broker
masteretcd workermasteretcd worker
PKS Control Plane

57. • VMware Registry
• Role-based
• AD/LDAP
• Clair
•
•
• Restful API

58. BOSH
VMware GCP Azure Openstack AWS
Container
Registry
Kubernetes on BOSH (Kubo/CFCR)
NSX-T
GCP
Service
Broker
masteretcd workermasteretcd worker
PKS Control Plane

59. NSX-T
• CNI
• VM
•
• vSphere

60. BOSH
VMware GCP Azure Openstack AWS
Container
Registry
Kubernetes on BOSH (Kubo/CFCR)
NSX-T
GCP
Service
Broker
masteretcd workermasteretcd worker
PKS Control Plane

61. PKS API ODB-PKS
masteretcd worker
masteretcd worker
masteretcd worker
pks create mycluster cf create-service pks-odb