The document discusses building Kubernetes as a service at scale, highlighting best practices, management challenges, and the importance of automation in Kubernetes operations. It includes insights from experts in the field and emphasizes integrating Kubernetes with data services for enhanced functionality. Additionally, the document outlines various phases of Kubernetes adoption, features, and components necessary for effective deployment and management.

1. Building Kubernetes
as a Service at Scale
Delivering Kubernetes Service on Any Infrastructure

2. Chris Gaun
PMM at Mesosphere /
Kubernetes Expert /
CNCF Ambasador
● Previous to that
Gartner analyst
covering public IaaS
● Kubernetes
community for 3 years

3. Jörg Schad
Technical Community
Lead / Mesos Developer
● Core Mesos
developer at
Mesosphere
● Deep learning and
Kubernetes expert

4. Market
Landscape
Guidance
● What’s the state of service?
CNCF: Cloud Native Landscape
● How is it incorporated in solution?
● How do you manage each service?
Missing:

5. Kubernetes Features vs. Community Projects
Pod Horizontal Autoscaling,
ReplicaSet
IaaS autoscaling,
VM orchestration
Yes No
Yes No
Yes No
Yes No
Low High
Low High
Examples
Part of Kubernetes
Tested as Part of
Kubernetes
Vetted by Kubernetes
Stakeholders
Standard Commercial
Support
Version Risk
API Changes or
Depreciation Risk
Features Projects
Kubernetes Features
● Rigorous Testing & Integration
○ Stable
○ Versioned
○ Discoverable
○ Included in apiserver
○ Include client support
● Included in Kubernetes API &
Documentation
● Avoids OpenStack’s open-
endedness & prevents
snowflakes

6. Compounded
Complexity
Kelsey Hightower
Kubernetes Thought Leader
Ranked #1 K8s Influencer
Staff Developer Advocate
PM & Chief Advocate
Top
Kubernetes
Advocate

7. Security &
Compliance
Automated
Management
as-a-Service
Delivery
Monitoring and
Logging
DATA SERVICES, MACHINE LEARNING, & AI
& zMORE
Bringing End-to-End as a Service Solution Together
MICROSERVICES, CONTAINERS, & DEV TOOLS
& MORE

8. Bootcamp: Building Kubernetes-as-a-Service at
Scale, Anywhere
● Episode 1: Building Kubernetes-as-a-Service
at Scale
● Episode 2: Deploying Kubernetes at Scale
with DC/OS
● Episode 3: Kubernetes and Big Data
Services
● Episode 4: Operating Kubernetes at Scale
with DC/OS
● End-to-end components
and best practices
● Automated management
of Kubernetes
● Connecting Kubernetes
to Big Data services
● Delivering an entire
Kubernetes solution

9. Poll Question
1. What phase is your organization’s Kubernetes
journey?
a. Have not started
b. Actively researching container orchestration
options
c. Planning a production Kubernetes project
d. Managing a production Kubernetes cluster

10. Introduction to Mesosphere

11. CONFIDENTIAL
Make it insanely easy
to build and scale
world-changing technology

12. PHYSICAL INFRASTRUCTURE
MICROSERVICES, CONTAINERS, & DEV TOOLS
VIRTUAL MACHINES PUBLIC CLOUDS
DATA SERVICES, MACHINE LEARNING, & AI
Security &
Compliance
Application-Aware
Automation
Multitenancy
Hybrid Cloud
Management
100+
MORE
DatacenterEdge
Datacenter and Cloud as a Single Computing Resource
Powered by Apache Mesos
20+
MORE
Unified hybrid cloud operations
Securely manage cloud, datacenter, and edge
infrastructures from a single control plane
4
Intelligent resource pooling
Optimize workload density for highest utilization with
resource guarantees
3
Broad workload coverage
Run today & tomorrow’s applications including traditional
J2EE, containers, analytics & ML
1
Application-aware automation
Automate workload-specific operating procedures to “as-a-
Service” anything from Kubernetes to data services
2
Kubernetes and Fast Data Automation

13. The premier platform to run data-driven,
containerized applications on any infrastructure
North American
Banks
Worldwide Telco
Companies
Highest-Valued
Startups
Automotive
Technology Efforts
Represents organizations using Mesosphere technologies
5 of Top 1030% of 7 of Top 12 5 of Top 10 6 Leading

14. Mesosphere powers data-driven applications across industries

15. Kubernetes Management

16. - RBAC + IAM
- Network segmentation
- OSS framework/ container control
- Multiple isolated clusters
- Vanilla / standard / OSS Kubernetes
- Identical setup / components / no snowflakes
- Multi/hybrid cloud
- Multi data center
- Easy updating / versioning
- Scaling
- Integrations - ELB, networking, Storage, Monitoring
- Easy installation
Security
Interoperability
Easy
Management
Delivering Kubernetes Challenges
Where they run Kubernetes
Multiple management hurdles
42%
On
Prem
57%
DIY
AWS
~40%
40+%
Require more security for wider
deployment
CNCF poll

17. What’s Kubernetes Done Right?
● Automated - Kubernetes operations should be
automated
● Evergreen - You want to always run the latest version of
Kubernetes a
● Included - Kubernetes is a commoditized standard that is
included
● Open source - Market standard is pure open source
Kubernetes
● Unified - Kubernetes is not an island, you’ll have other
workloads

18. Engine crank to start Turn key
Shift into gear
First Cars Cars Today
Automatic
transmission
Drive from A to B
Self-driving…
ish
Declarative
Intelligent Resource Pooling
Evolution of Management Automation

19. Simple HA
Cluster
Provisioning
Robust API
Server Auth
Non-disruptive
Upgrades
Automated self-
healing
Scalable
Kubernetes
Transport Layer
Security
Developer and Fast
Data Services
Kubernetes Automated Management with DC/OS

20. Simple HA Cluster
Provisioning
Kubernetes Automated Management with DC/OS
Robust API
Server Auth
Non-disruptive
Upgrades
Automated
self-healing
Scalable
Kubernetes
Transport Layer
Security
Developer and Fast
Data Services

21. Dead Simple Highly Available Provisioning
1. Prerequisites
2. Installing the Client Tools
3. Provisioning Compute Resources
4. Provisioning the CA and Generating TLS Certificates
5. Generating Kubernetes Configuration Files for Authentication
6. Generating the Data Encryption Config and Key
7. Bootstrapping the etcd Cluster… 3x for HA
10. Bootstrapping the Kubernetes Control Plane… 3x for HA
13. Bootstrapping the Kubernetes Worker Nodes
14. Configuring kubectl for Remote Access
15. Provisioning Pod Network Routes
16. Deploying the DNS Cluster Add-on… Deploying other Add-ons
20. Smoke Test
21. Cleaning Up
We turn this (21 steps)*….
$ dcos package install
kubernetes
Into this….
* Kubernetes the Hard Way by Kelsey Hightower

22. 22
Kubernetes Open Source Quickstart
1. Few commands to running on
public cloud
2. Large microservice catalog
3. Search “DC/OS Kubernetes
Quickstart Github” |
https://github.com/mesospher
e/dcos-kubernetes-quickstart

23. Kubernetes is Not an Island

24. Enabling Developer Agility:
Kubernetes is one part of a holistic CI/CD pipeline
Source Code
Control
Build and Test Release
Deploy, Monitor
and Log
Automatically trigger CI/CD
pipeline based on code check-
in.
Start automated build and test,
including functional, security
and performance tests.
Update artifact repository with
latest successful code artifacts
and pull newest images
Deploy applications to container
orchestration and watch with
monitoring and logging
CONTINUOUS INTEGRATION (CI)
CONTINUOUS DEPLOYMENT
(CD)

25. Delivering Popular Tools as-a-Service
25
Mesos
Master
Mesos
Master
Mesos
Master
Mesos AgentMesos Agent Service
Cassandra
Executor
Cassandra
Task
Spinnaker
Executor
Spinnaker
Task
Mesos AgentMesos Agent Service
Docker
Executor
Docker
Task
K8s Executor
K8s
Task
Intelligent Resource Pooling
1. Agents advertise resources to
Master
2. Master offers resources to
Services
3. Services rejects / uses resources
4. Agent reports task status to
Master

26. DC/OS intelligent
resource pooling
runs multiple
distribute services
in a single
infrastructure

27. Transforming DevOps to Site Reliability Engineering
● Multi-dimensional metrics and modeling
● Often coupled with Grafana dashboard
a. Public ones rarely updated
b. Application level metrics
c. Cluster (node) level metrics
d. Networking information
● Supports multiple cluster metric aggregation
● Many monitoring vendors offering integration

28. Need to Enhance & Automate
Security
● Secure Authentication, Authorization and In-
Transit Data Encryption
● Enable Authentication of Users, Apps
(Client-Server) & Inter-Service
Communication (Server to Server)
● Easy Transport Layer Security (TLS)
● Automate operational overhead

29. Mesosphere & Kubernetes
CNCF certified Kubernetes
Founder on CNCF board |
Platinum Member
Co-founder Container
Storage Interface
Original member of Open
Container Initiative
DC/OS is greatest Cloud Native Landscape*
Enabler
100+ cloud native tools on demand
* https://github.com/cncf/landscape (majority of northbound OSS tools are supported on DC/OS

30. Download Now
https://mesosphere.com/resource/category/ebook/

31. 31
Sign Up For Slack
1. Slack URL: https://chat.dcos.io/
2. Join #kubernetes channel
3. OSS support / feedback