© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kubernetes as a platform Vs.
Kubernetes as an API
Massimo Re Ferrè
Senior Principal Technologist @ AWS
Incontro DevOps Italia (IDI) 2023
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
If you fall asleep in the next 30 mins, read this
https://aws.amazon.com/blogs/containers/kubernetes-as-a-platform-vs-kubernetes-as-an-api-2/
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
My preferred interview question
“What is Kubernetes? Explain it to me like I am 5yo”
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K8s is my control plane and data plane
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
Kubernetes / Amazon EKS
Service
Controller
Database
Pod
Service
CRD
Postgres
Controller
Postgres
CRD
Operators
NGINX
Controller
L7
proxy
Application
Pod
AWS resources
Kubernetes resources
….
EBS
EFS
VPC
CSI / CNI Drivers
Application workloads
Cluster
Autoscaler
Horizontal
Pod
Autoscaler
Infrastructure workloads
Prometheus
Grafana
Pod
Controller
Pod
CRD
Built-in
…
…
Ingress
CRD
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real life K8s as a platform is harder than that
https://www.kubeflow.org/docs/started/architecture/
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K8s is my control plane and data plane
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
Kubernetes / Amazon EKS
Service
Controller
Database
Pod
Service
CRD
Postgres
Controller
Postgres
CRD
Operators
NGINX
Controller
L7
proxy
Application
Pod
AWS resources
Kubernetes resources
….
EBS
EFS
VPC
CSI / CNI Drivers
Application workloads
Cluster
Autoscaler
Horizontal
Pod
Autoscaler
Infrastructure workloads
Prometheus
Grafana
Pod
Controller
Pod
CRD
Built-in
…
…
Ingress
CRD
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K8s is(some of) my control plane and(some of my ) data plane
Kubernetes / Amazon EKS
Service
Controller
Amazon RDS
(Postgres)
Service
CRD
Application
Pod
AWS resources
Kubernetes resources
CSI / CNI Drivers
Application workloads
Karpenter
Horizontal
Pod
Autoscaler
Infrastructure workloads
Pod
Controller
Pod
CRD
Built-in
…
…
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
ALB
Controller
Ingress
CRD
….
EBS
EFS
VPC
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
But now I have two separate IaC…
Kubernetes / Amazon EKS
Service
Controller
Amazon RDS
(Postgres)
Service
CRD
Application
Pod
AWS resources
Kubernetes resources
CSI / CNI Drivers
Application workloads
Karpenter
Horizontal
Pod
Autoscaler
Infrastructure workloads
Pod
Controller
Pod
CRD
Built-in
…
…
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
ALB
Controller
Ingress
CRD
….
EBS
EFS
VPC
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
Terraform / CFN / CDK / Pulumi / …
Kubernetes YAML / Helm / …
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Enter ACK (e.g. deploy RDS with K8s YAML)
Kubernetes / Amazon EKS
Service
Controller
Service
CRD
Application
Pod
AWS resources
Kubernetes resources
CSI / CNI Drivers
Application workloads
Karpenter
Horizontal
Pod
Autoscaler
Infrastructure workloads
Pod
Controller
Pod
CRD
Built-in
…
…
ALB
Controller
RDS
Controller
RDS
CRD
ACK
Ingress
CRD
….
EBS
EFS
VPC
Amazon RDS
(Postgres)
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
Kubernetes YAML / Helm / …
https://aws-controllers-k8s.github.io/community/
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Running workloads in K8s is... work…
Kubernetes / Amazon EKS
Service
Controller
Service
CRD
Application
Pod
AWS resources
Kubernetes resources
CSI / CNI Drivers
Application workloads
Horizontal
Pod
Autoscaler
Infrastructure workloads
Pod
Controller
Pod
CRD
Built-in
…
…
ALB
Controller
RDS
Controller
RDS
CRD
ACK
Karpenter
Ingress
CRD
….
EBS
EFS
VPC
Amazon RDS
(Postgres)
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Can we think bigger?
- If we agree that Kubernetes is “a well-designed and extensible API
with programmable reconciliation logic, that happens to come with a
container orchestrator built in”…
- Have we simplified enough?
- Can we offload more?
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K8s is my control plane but NOT my data plane
Kubernetes / Amazon EKS
Service
Controller
Service
CRD
AWS resources
Kubernetes resources
Pod
Controller
Pod
CRD
Built-in
…
…
Amazon ECS
RDS
Controller
RDS
CRD
ACK
ECS
Controller
ECS
CRD
Amazon RDS
(Postgres)
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K8s is my control plane but NOT my data plane
Kubernetes / Amazon EKS
Service
Controller
Service
CRD
AWS resources
Kubernetes resources
Pod
Controller
Pod
CRD
Built-in
…
…
RDS
Controller
RDS
CRD
ACK
ECS
Controller
ECS
CRD
Apply
state
Read
state
Amazon ECS
Amazon RDS
(Postgres)
Amazon ALB
Amazon
Managed
Grafana
Amazon
Managed
Prometheus
AmazonEC2
AWS Fargate
Amazon VPC
Amazon EBS
Amazon EFS
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ECS ACK Demo
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Kubernetes? Hot takes only…
- a container orchestrator (an alternative to ECS)
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Kubernetes? Hot takes only…
- a container orchestrator (an alternative to ECS)
- a re-base of cloud services
- a proxy to cloud services
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Massimo Re Ferrè
@mreferre (Twitter | email | GitHub)

IDI_2023_MRF-Final.pdf

  • 1.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Kubernetes as a platform Vs. Kubernetes as an API Massimo Re Ferrè Senior Principal Technologist @ AWS Incontro DevOps Italia (IDI) 2023
  • 2.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. If you fall asleep in the next 30 mins, read this https://aws.amazon.com/blogs/containers/kubernetes-as-a-platform-vs-kubernetes-as-an-api-2/
  • 3.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. My preferred interview question “What is Kubernetes? Explain it to me like I am 5yo”
  • 4.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. K8s is my control plane and data plane AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS Kubernetes / Amazon EKS Service Controller Database Pod Service CRD Postgres Controller Postgres CRD Operators NGINX Controller L7 proxy Application Pod AWS resources Kubernetes resources …. EBS EFS VPC CSI / CNI Drivers Application workloads Cluster Autoscaler Horizontal Pod Autoscaler Infrastructure workloads Prometheus Grafana Pod Controller Pod CRD Built-in … … Ingress CRD
  • 5.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Real life K8s as a platform is harder than that https://www.kubeflow.org/docs/started/architecture/
  • 6.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. K8s is my control plane and data plane AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS Kubernetes / Amazon EKS Service Controller Database Pod Service CRD Postgres Controller Postgres CRD Operators NGINX Controller L7 proxy Application Pod AWS resources Kubernetes resources …. EBS EFS VPC CSI / CNI Drivers Application workloads Cluster Autoscaler Horizontal Pod Autoscaler Infrastructure workloads Prometheus Grafana Pod Controller Pod CRD Built-in … … Ingress CRD
  • 7.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. K8s is(some of) my control plane and(some of my ) data plane Kubernetes / Amazon EKS Service Controller Amazon RDS (Postgres) Service CRD Application Pod AWS resources Kubernetes resources CSI / CNI Drivers Application workloads Karpenter Horizontal Pod Autoscaler Infrastructure workloads Pod Controller Pod CRD Built-in … … Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus ALB Controller Ingress CRD …. EBS EFS VPC AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS
  • 8.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. But now I have two separate IaC… Kubernetes / Amazon EKS Service Controller Amazon RDS (Postgres) Service CRD Application Pod AWS resources Kubernetes resources CSI / CNI Drivers Application workloads Karpenter Horizontal Pod Autoscaler Infrastructure workloads Pod Controller Pod CRD Built-in … … Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus ALB Controller Ingress CRD …. EBS EFS VPC AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS Terraform / CFN / CDK / Pulumi / … Kubernetes YAML / Helm / …
  • 9.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Enter ACK (e.g. deploy RDS with K8s YAML) Kubernetes / Amazon EKS Service Controller Service CRD Application Pod AWS resources Kubernetes resources CSI / CNI Drivers Application workloads Karpenter Horizontal Pod Autoscaler Infrastructure workloads Pod Controller Pod CRD Built-in … … ALB Controller RDS Controller RDS CRD ACK Ingress CRD …. EBS EFS VPC Amazon RDS (Postgres) Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS Kubernetes YAML / Helm / … https://aws-controllers-k8s.github.io/community/
  • 10.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Running workloads in K8s is... work… Kubernetes / Amazon EKS Service Controller Service CRD Application Pod AWS resources Kubernetes resources CSI / CNI Drivers Application workloads Horizontal Pod Autoscaler Infrastructure workloads Pod Controller Pod CRD Built-in … … ALB Controller RDS Controller RDS CRD ACK Karpenter Ingress CRD …. EBS EFS VPC Amazon RDS (Postgres) Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS
  • 11.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Can we think bigger? - If we agree that Kubernetes is “a well-designed and extensible API with programmable reconciliation logic, that happens to come with a container orchestrator built in”… - Have we simplified enough? - Can we offload more?
  • 12.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. K8s is my control plane but NOT my data plane Kubernetes / Amazon EKS Service Controller Service CRD AWS resources Kubernetes resources Pod Controller Pod CRD Built-in … … Amazon ECS RDS Controller RDS CRD ACK ECS Controller ECS CRD Amazon RDS (Postgres) Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS
  • 13.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. K8s is my control plane but NOT my data plane Kubernetes / Amazon EKS Service Controller Service CRD AWS resources Kubernetes resources Pod Controller Pod CRD Built-in … … RDS Controller RDS CRD ACK ECS Controller ECS CRD Apply state Read state Amazon ECS Amazon RDS (Postgres) Amazon ALB Amazon Managed Grafana Amazon Managed Prometheus AmazonEC2 AWS Fargate Amazon VPC Amazon EBS Amazon EFS
  • 14.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. ECS ACK Demo
  • 15.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. What is Kubernetes? Hot takes only… - a container orchestrator (an alternative to ECS)
  • 16.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. What is Kubernetes? Hot takes only… - a container orchestrator (an alternative to ECS) - a re-base of cloud services - a proxy to cloud services
  • 17.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Thank you! © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Massimo Re Ferrè @mreferre (Twitter | email | GitHub)