Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus

•

1 like•405 views

This document summarizes Zalando's cloud native infrastructure. It discusses Zalando's scale with 17 markets, 7 fulfillment centers, and over 200 million monthly visits. It then describes Zalando Tech's use of Kubernetes and AWS, including their use of tools like the Cluster Lifecycle Manager and Postgres Operator. It also outlines their CI/CD pipeline using the Continuous Delivery Platform and observability tools like ZMon and Grafana. Finally, it discusses autoscaling and many of Zalando's open source projects related to their cloud native infrastructure.

Software

Cloud Native
Infrastructure
@Zalando
Cloud Native Aarhus
November 6th 2018
MIKKEL LARSEN
@mikkeloscar
2018-11-06

2
17 markets
WE BRING FASHION TO PEOPLE IN 17 COUNTRIES
7 fulfillment centers
23 million active customers
4.5 billion € net sales 2017
200 million visits per month
15,000 employees in Europe

3
ZALANDO TECH
~ 2.000
Employees in Tech
~ 300
Delivery teams

5
INFRASTRUCTURE HISTORY @ ZALANDO
STUPS
(toolset around AWS)
Kubernetes
AWS accounts per team.
All instances must run the same AMI.
PowerUser access to Production.
Clusters per product (multiple teams).
Instances are not managed by teams.
Hands off approach.
You build it, you run EVERYTHING. A lot of stuff out of the box.

6
KUBERNETES CLUSTER SETUP
Master
Config
Worker
EC2
Instances
CloudFormation
Stacks
github.com/zalando-incubator/kubernetes-on-aws
Master

7
CLUSTER PROVISIONING
CLUSTER LIFECYCLE MANAGER (CLM)
ADMIN
create
apply manifests
provision
resources
create
CF stack
CLUSTER
REGISTRY
CLM
API
...
...
...
CloudFormation
API
github.com/zalando-incubator/cluster-lifecycle-manager
github.com/zalando-incubator/kubernetes-on-aws

8
INGRESS
https://github.com/zalando-incubator/kube-ingress-aws-controller

10
POSTGRES AS A SERVICE
apiVersion: "acid.zalan.do/v1"
kind: "postgresql"
metadata:
name: "test-cluster"
namespace: "default"
spec:
teamId: "teapot"
postgresql:
version: "10"
numberOfInstances: 3
volume:
size: "10Gi"

11
POSTGRES OPERATOR
github.com/zalando-incubator/postgres-operator
Node
pg
role=master
Node
pg
role=replica
Node
pg
role=replica
Node
postgres
operator
Evict
✘
evict
pg
role=replica
promote
role=masterrole=replica
drain
✓

12
POSTGRES OPERATOR
github.com/zalando-incubator/postgres-operator
apiVersion: policy/v1beta1
kind: PodDisruptionBudget
metadata:
name: "postgres-cluster"
spec:
minAvailable: 1
selector:
matchLabels:
application: “postgres-cluster”
role: “master”

14
CONTINUOUS DELIVERY PLATFORM (CDP)
BUILD PIPELINE
GHE
(pull-request)
trigger
push code
push
Build VMs
Plain Ubuntu
No credentials zone

15
CONTINUOUS DELIVERY PLATFORM (CDP)
BUILD DEFINITION
RY MANAGER

16
CONTINUOUS DELIVERY PLATFORM (CDP)
BUILD OUTPUT
RY MANAGER

17
CONTINUOUS DELIVERY PLATFORM (CDP)
DEPLOYMENT PIPELINE
GHE
deploytrigger
push code
(yaml)
pull

18
CONTINUOUS DELIVERY PLATFORM (CDP)
DEPLOYMENT DEFINITION
RY MANAGER

19
CONTINUOUS DELIVERY PLATFORM (CDP)
DEPLOYMENT OUTPUT
RY MANAGER

24
ZMON DASHBOARD
github.com/zalando/zmon

27
CLUSTER AUTOSCALER
1a
1b
1c
Node Pool: General purpose (m5.2xlarge)
1a
1b
1c
Node Pool: GPU (p3.2xlarge)
github.com/kubernetes/autoscaler + patches

28
HORIZONTAL POD AUTOSCALING (CUSTOM METRICS)
Queue Length
Prometheus Query
Ingress Req/s
ZMON Check
github.com/zalando-incubator/kube-metrics-adapter

29
HORIZONTAL POD AUTOSCALING (CUSTOM METRICS)
JOB SCALING TO CONSUME EVENTS (ZMON CHECK)

30
OPEN SOURCE
Cluster Lifecycle Manager
github.com/zalando-incubator/cluster-lifecycle-manager
Kubernetes on AWS
github.com/zalando-incubator/kubernetes-on-aws
AWS ALB Ingress controller
github.com/zalando-incubator/kube-ingress-aws-controller
Skipper HTTP Router & Ingress controller
github.com/zalando/skipper
External DNS
github.com/kubernetes-incubator/external-dns
Postgres Operator
github.com/zalando-incubator/postgres-operator
Kube Metrics Adapter
github.com/zalando-incubator/kube-metrics-adapter

MIKKEL LARSEN
mikkel.larsen@zalando.de
@mikkeloscar
Illustrations by @01k, @kcgreenn, @ntakayama
2018-07-12
SENIOR SOFTWARE ENGINEER
PLATFORM INFRASTRUCTURE

Operating stateful applications is a challenge and Elasticsearch clusters are no exception. At Zalando, the search department has a long-term history of operating large-scale Elasticsearch clusters consisting of 100s of nodes. In this talk Mikkel and Oliver present how Zalando utilizes Kubernetes and the operator pattern as introduced by CoreOS, to reliably and cost efficiently operate large-scale Elasticsearch clusters. The talk will walk through how the Elasticsearch operator was designed, what problems it solves and how building it from the bottom up allowed getting it in production fast, gather more learnings and later extending the featureset to make it less manual to operate and reducing the cost of the overall infrastructure by introducing auto-scaling. While the talk revolves around running Elasticsearch, the ideas presented also apply to running other types of stateful applications in Kubernetes. Additionally, the Elasticsearch operator presented, can be used by anyone. It is planned to be published as open-source solution in the future.

Kubernetes on AWS at Europe's Leading Online Fashion Platform

Henning Jacobs

Docker Berlin Meetup Nov 2015: Zalando Intro

Henning Jacobs

Python at Zalando Technology @ Python Users Berlin Meetup September 2015

Henning Jacobs

This document provides an overview of Zalando Technology including that it is one of Europe's largest online fashion retailers with over 8,000 employees across 15 countries. It notes that Zalando Tech is headquartered in Berlin with over 800 technologists and that they focus on API-first microservices architecture in the cloud with an emphasis on Python, PostgreSQL, and open source. Key technical areas include infrastructure, web applications, data intelligence, and monitoring.

STUPS by Zalando @ AWS User Group Ireland Meet Up September 2015

Henning Jacobs

STUPS by Zalando @WHD.local Frankfurt: STUPS.io - an Open Source Cloud Framew...

Henning Jacobs

This talk shed lights on how Zalando, Europe’s leading eCommerce platform for fashion, has developed an architecture and set of open source cloud tools that scales as its technology team (100 autonomous engineering teams and counting) grows and evolves. It also describes the challenges regarding compliance and innovation that we face, and how we built our cloud infrastructure on top of AWS and Docker to manage these challenges. Talk given by Henning Jacobs at the WHD.local event in Frankfurt on September 10th 2015.

Docker in der AWS Cloud

Sascha Möllering

This document discusses deploying Docker containers on Amazon Web Services. It covers using AWS services like EC2, OpsWorks and Elastic Beanstalk that support Docker. It describes using the EC2 Container Service for container management and deploying containers across a cluster of EC2 instances. It also discusses the immutable server pattern of deploying to new infrastructure with each release rather than changing existing servers.

トレノケ雲の会 mod.1 IBMのクラウドを掴んでみよう

Shoichiro Sakaigawa

This document discusses the speaker's background working with IBM Cloud technologies like Kubernetes, Docker, OpenWhisk, and IBM Cloud Container Service. It provides information on upcoming events where the speaker will present, including a Think Japan Developer Day on June 11th where they will discuss IBM Cloud and give three talks. Details are given for an IoT/SIer meetup on May 22nd where the speaker will demonstrate a Raspberry Pi project using Node-RED.

This talk shed lights on how Zalando, Europe’s leading ecommerce platform for fashion, has developed an architecture and set of open source cloud tools that scales as its technology team (100 autonomous engineering teams and counting) grows and evolves. It also describes the challenges regarding compliance and innovation that teams of our size face, and how we built our cloud infrastructure on top of AWS and Docker to manage these challenges. http://gotocon.com/amsterdam-2015/presentation/A%20Cloud%20Infrastructure%20for%20Scaling%20Innovation%20Across%20Autonomous%20Teams

Docker on AWS

Sascha Möllering

This document discusses using Docker on AWS. It describes using Docker to deploy highly scalable applications across multiple AWS regions and availability zones. It also discusses using a private Docker registry hosted on EC2 and S3 to store custom Docker images. Finally, it summarizes using Amazon EC2 Container Service (ECS) for container management on AWS, including concepts like clusters, tasks, and container instances.

Kubernetes at Zalando - CNCF End User Committee Presentation

Henning Jacobs

This document summarizes Zalando's use of Kubernetes on AWS. It discusses how Zalando uses Kubernetes across 200+ engineering teams, 30+ production clusters, and 8 non-production clusters. Key aspects covered include the architecture with isolated AWS accounts per product, cluster provisioning via CloudFormation, deployment via Jenkins pipelines, ingress controller, integration with AWS services, cluster autoscaling, OAuth integration, operations, monitoring with ZMON, and open sourcing of tools like the Kubernetes ingress controller and external DNS. Overall experience has been positive but missing best practices have been challenging and community/user discussions have been very helpful.

Melodic Keynote presentation at OW2con'19, June 12-13, Paris.

OW2

REX: Cloud Native Apps on a K8S stack

Mathieu Herbert

This document summarizes the evolution of a company's cloud native applications on a Kubernetes stack from 2018 to present. It started with 1000+ Kubernetes nodes hosting 18K pods and handling 650 requests/second across 2 cloud providers. Over the years, the company expanded its use of Kubernetes, added more applications, services, and tools for monitoring, logging, ingress control, and more. It now aims to improve developer experience, continue migrating infrastructure services to Kubernetes, and implement its first FinOps tool.

Kubernetes: Managed or Not Managed?

Mathieu Herbert

This document discusses whether to use a managed or self-managed Kubernetes cluster. It describes Talend's initial deployment of Kubernetes using Kubespray on VMs, which required significant effort for upgrades and maintenance. It then discusses moving to Amazon EKS which simplified deployment and reduced monthly costs from $438 to $144, allowing Talend to focus more on applications. While EKS has limitations like a black box control plane, it offers easier setup and an evolving platform supported by AWS. The conclusion is that managed Kubernetes is good for application focus with small ops teams, while self-managed is better if fully controlling the infrastructure is important.

DevOps Con 2015: Radical Agility with Autonomous Teams and Microservices in t...

Henning Jacobs

This document summarizes a talk on "Radical Agility with Autonomous Teams and Microservices in the Cloud" given by Henning Jacobs and Jan Löffler from Zalando. It discusses how Zalando has adopted a microservices architecture and autonomous DevOps teams to manage the complexity of operating a large e-commerce business across Europe. The talk focuses on how microservices and cloud infrastructure enable faster development and system scalability while reducing dependencies between teams. It also describes Zalando's approach to DevOps, where it is treated as a "first-class entity" and teams have a high degree of autonomy.

Toronto Code Camp 2009 Andy Nogueira

Andy Nogueira

SmartCity IoT on Kubernetes and OpenStack

Jakub Pavlik

Urturn on AWS: scaling infra, cost and time to maket

Swiss Big Data User Group

The document discusses Urturn's infrastructure on AWS and how it has scaled over time. Some key points: - Urturn initially used AWS to scale its infrastructure quickly and reduce costs and time to market. - The architecture included load balancers, web and application servers, databases, caching, and storage on AWS. - Over time Urturn leveraged more AWS services like spot instances, load testing, and additional databases and caches. - If starting again, Urturn would consider using more native AWS services like DynamoDB, RDS, CloudSearch, SQS, SES, and ElastiCache.

Kubernetes on AWS @Zalando - Berlin AWS User Group 2017-05-09

Henning Jacobs

In this talk we share our learnings from running Kubernetes on AWS in production and how we are migrating 200+ engineering teams from AWS/STUPS to Kubernetes. This talk was given at the Berlin AWS User Group meetup on 2017-05-09 hosted by NewStore (https://www.meetup.com/aws-berlin/events/236795816/). More information on http://kubernetes-on-aws.readthedocs.io/en/latest/admin-guide/kubernetes-in-production.html

ITGM#14 - How do we use Kubernetes in Zalando

Uri Savelchev

This document discusses Zalando's use of Kubernetes in their technology infrastructure. It describes their motivation for adopting Kubernetes which included improved resource efficiency, cost efficiency, velocity and compliance. It provides an overview of their Kubernetes architecture which includes fully automated operations with no manual cluster management, single production clusters per product, control plane components running separately from nodes, and multi-AZ clusters. It also discusses how their continuous delivery platform integrates with Kubernetes to deploy applications and with AWS for infrastructure provisioning.

Developer Journey at Zalando - Idea to Production with Containers in the Clou...

Henning Jacobs

Talk held on R-ETAIL:CODE in London on 2018-03-15. - The history of how DevOps evolved at Zalando: from on-premise data centers to autonomous teams, microservices and cluster management in the cloud - How the developer experience looks like for the application lifecycle from idea to production and what our vision for the future is - Challenges and learnings from our past experiences: why architecture principles and constraints are important to lead 200+ engineering teams

How do we use Kubernetes

Uri Savelchev

Zalando uses Kubernetes extensively to manage its technology infrastructure and platforms. It currently operates 99 clusters across 380 AWS accounts. Key aspects of Zalando's Kubernetes architecture include using one production cluster per product, running etcd separately on EC2 instances, implementing multi-AZ clusters, providing isolated live and test environments, and integrating Kubernetes deployments with its continuous delivery platform and AWS using tools like kube2iam. Zalando has also developed and contributed several open source projects related to Kubernetes operations.

Open Source at Zalando - OSB Open Source Day 2019

Henning Jacobs

Kubernetes on AWS @ Zalando Tech

Michael Dürgner

This document summarizes Michael Duergner's presentation on Kubernetes and AWS at Zalando. Some key points: 1. Zalando is a large European fashion retailer that uses Kubernetes on AWS to run its infrastructure across 15 markets and 6 fulfillment centers. 2. Zalando developed its own solutions like the Kubernetes ingress controller for AWS and PostgreSQL operator to run its workloads on Kubernetes in a scalable and reliable way across 30 production clusters. 3. Some challenges of using Kubernetes at large scale include stability during cluster updates, ease of onboarding over 200 teams, and providing a good user experience when combining Kubernetes and AWS configurations.

Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...

Henning Jacobs

While the adoption of DevOps makes teams move faster with reduced dependency on central operations, it can constrain teams who lack the skills to self-manage the full application and infrastructure stack. The way to overcome this challenge is creating an internal platform and treating it as a world-class product offering. “Applying product management to internal platforms means establishing empathy with internal consumers (read: developers) and collaborating with them on the design. Platform product managers establish roadmaps and ensure the platform delivers value to the business and enhances the developer experience”, via ThoughtWorks Technology Radar. In this talk, Henning Jacobs will walk you through how Zalando adopted a customer-first mindset with regards to its developer tooling. He will show the effect on developer satisfaction when internal platforms are given the same respect as external product offerings. Henning will furthermore tell his story about how Zalando moved from a classical infrastructure team to a product mindset with strong focus on building a world-class developer experience. Henning shares both their learnings and challenges going through this transition, and the impact it has on the daily life of Zalando’s customers (developers). This talk was given in Aarhus on 4th of June 2019.

How Zalando runs Kubernetes clusters at scale on AWS - AWS re:Invent

Henning Jacobs

Many clusters, many problems? Having many clusters has benefits: reduced blast radius, less vertical scaling of cluster components, and a natural trust boundary. In this session, Zalando shows its approach for running 140+ clusters on AWS, how it does continuous delivery for its cluster infrastructure, and how it created open-source tooling to manage cost efficiency and improve developer experience. The company openly shares its failures and the learnings collected during three years of Kubernetes in production. AWS re:Invent session OPN211 on 2019-12-05

Microservices architecture: practical aspects

Antonio Sagliocco

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - A...

Henning Jacobs

Bootstrapping a Kubernetes cluster is easy, rolling it out to nearly 200 engineering teams and operating it at scale is a challenge. In this talk, we are presenting our approach to Kubernetes provisioning on AWS, operations and developer experience for our growing Zalando Technology department. We will highlight in the context of Kubernetes: AWS service integrations, our IAM/OAuth infrastructure, cluster autoscaling, continuous delivery and general developer experience. The talk will cover our most important learnings and we will openly share failure stories. Presented on 2017-09-28 at AWS Tech Community Days in Cologne.

2018 04-06 kubernetes ingress in production

Sandor Szuecs

Talk Abstract At Zalando we run 84 Kubernetes clusters in AWS. Ingress objects are enough to provision ALBs, do advanced HTTP routing and create DNS records. I will show how to support green-blue deployments, A/B testing, shadow traffic and feature toggles with the current ingress and our Open Source tools. Talk Description One of the hottest topics in Kubernetes is how to do ingress traffic done right. This is an opinionated talk that shows how one of the biggest online shops in Europe does it. All tools are Open Source and can be used by the audience. Presented use cases are production relevant. notes - Since 7 years I work as system and software engineer for Zalando. - I work in the team that runs 84 Kubernetes clusters for Zalando. - I am one of the core developers, which implements all the ingress features being presented.

What's hot

dotNet conf 2018 fukuoka azure 引越し

yukiusagi2052

GOTO Amsterdam 2015: A Cloud Infrastructure for Scaling Innovation Across Aut...

Henning Jacobs

Docker on AWS

Sascha Möllering

Kubernetes at Zalando - CNCF End User Committee Presentation

Henning Jacobs

Melodic Keynote presentation at OW2con'19, June 12-13, Paris.

OW2

REX: Cloud Native Apps on a K8S stack

Mathieu Herbert

Kubernetes: Managed or Not Managed?

Mathieu Herbert

DevOps Con 2015: Radical Agility with Autonomous Teams and Microservices in t...

Henning Jacobs

Toronto Code Camp 2009 Andy Nogueira

Andy Nogueira

SmartCity IoT on Kubernetes and OpenStack

Jakub Pavlik

Urturn on AWS: scaling infra, cost and time to maket

Swiss Big Data User Group

Kubernetes on AWS @Zalando - Berlin AWS User Group 2017-05-09

Henning Jacobs

What's hot (12)

dotNet conf 2018 fukuoka azure 引越し

GOTO Amsterdam 2015: A Cloud Infrastructure for Scaling Innovation Across Aut...

Docker on AWS

Kubernetes at Zalando - CNCF End User Committee Presentation

Melodic Keynote presentation at OW2con'19, June 12-13, Paris.

REX: Cloud Native Apps on a K8S stack

Kubernetes: Managed or Not Managed?

DevOps Con 2015: Radical Agility with Autonomous Teams and Microservices in t...

Toronto Code Camp 2009 Andy Nogueira

SmartCity IoT on Kubernetes and OpenStack

Urturn on AWS: scaling infra, cost and time to maket

Kubernetes on AWS @Zalando - Berlin AWS User Group 2017-05-09

Similar to Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus

ITGM#14 - How do we use Kubernetes in Zalando

Uri Savelchev

Developer Journey at Zalando - Idea to Production with Containers in the Clou...

Henning Jacobs

How do we use Kubernetes

Uri Savelchev

Open Source at Zalando - OSB Open Source Day 2019

Henning Jacobs

Kubernetes on AWS @ Zalando Tech

Michael Dürgner

Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...

Henning Jacobs

How Zalando runs Kubernetes clusters at scale on AWS - AWS re:Invent

Henning Jacobs

Microservices architecture: practical aspects

Antonio Sagliocco

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - A...

Henning Jacobs

2018 04-06 kubernetes ingress in production

Sandor Szuecs

IDI 2020 - Containers Meet Serverless

Massimo Ferre'

Containers have been a driving force in this industry for the last 5+ years. In the meanwhile we have seen the raise of other compute patterns, such as serverless. 2020 seems to be the year where the line between containers and serverless starts to blurry. We are seeing the raise of container serverless platforms (e.g. AWS Fargate) as well as the raise of higher order abstractions above container platforms (e.g. OpenFaaS, ECS CLI v2, …) that allows developers to focus on their code instead of managing containers. In this session we will discuss how the serverless benefits are starting to permeate into the container ecosystem and we will provide real life examples of how some AWS and OSS technologies can be used to abstract and remove part of the undifferentiated heavy lifting developers often need to take care of.

Red hat ansible automation technical deck

Juraj Hantak

Kubernetes on AWS at Zalando: Failures & Learnings - DevOps NRW

Henning Jacobs

Es-operator: Building an Elasticsearch Operator from the bottom up - kube-con...

MikkelOscarLyderikLa

Zalando runs Kubernetes clusters to manage Elasticsearch workloads. They initially used StatefulSets but found it complicated to update Elasticsearch without changing replicas. They developed an operator to abstract Elasticsearch as reusable data sets. The operator handles scaling Elasticsearch up and down by adding or removing pods and shards based on metrics. It ensures updates are done safely by draining nodes and moving data before deleting pods. This allows advanced auto-scaling for cost efficiency and safe automatic updates of Elasticsearch and the Kubernetes cluster.

AWS Dev Days Tour Germany - Berlin, Cologne, Munich, Frankfurt - Containers T...

Andrea Mercanti

This document summarizes Reply, a consulting company that supports enterprises using new technologies. It discusses Reply's expertise in containers and AWS, providing two use cases. Reply is a network of companies that helps enterprises design solutions using new technologies. It has over 6,500 employees globally and expertise in containers, AWS, machine learning, security, and more. Reply has worked on over 500 cloud projects and has 60+ AWS certified consultants. Two use cases discussed are a streaming platform for a telco that uses containers and Kubernetes, and a car sensor data system for an automotive brand.

AWS Summit Tel Aviv - Startup Track - Continuous Deployment

Amazon Web Services

The document summarizes Tiago Henriques' presentation on continuous deployment at the AWS Summit 2013 in Tel Aviv. It describes how Tiago discussed using AWS services like CloudFormation to automate deployments and provision test environments on demand for low cost. It also outlines CloudOn's development and test deployment model of using "All In One" instances that allow developers to easily deploy any code branch for integration testing.

12.07.2017 Docker Meetup - KUBERNETES ON AWS @ ZALANDO TECH

Zalando adtech lab

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - C...

Henning Jacobs

Bootstrapping a Kubernetes cluster is easy, rolling it out to nearly 200 engineering teams and operating it at scale is a challenge. In this talk, we are presenting our approach to Kubernetes provisioning on AWS, operations and developer experience for our growing Zalando Technology department. We will highlight in the context of Kubernetes: AWS service integrations, our IAM/OAuth infrastructure, cluster autoscaling, continuous delivery and general developer experience. The talk will cover our most important learnings and we will openly share failure stories. Talk given at Container Days HH (https://containerdays.io/) on 2017-06-20.

Better Software is Better than Worse Software - Michael Coté (Cape Town 2019)

VMware Tanzu

This document discusses the benefits of a consistent platform and product process for building cloud native applications. It provides examples from various companies that illustrate how adopting these practices can increase developer productivity, reduce costs, speed up release cycles, and improve software quality. Maintaining a consistent platform with tools like Pivotal Application Service, Pivotal Container Service, and services from the Pivotal marketplace allows companies to focus on building applications rather than infrastructure.

From AWS/STUPS to Kubernetes on AWS @Zalando - Berlin Kubernetes Meetup

Henning Jacobs

Similar to Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus (20)

ITGM#14 - How do we use Kubernetes in Zalando

Developer Journey at Zalando - Idea to Production with Containers in the Clou...

How do we use Kubernetes

Open Source at Zalando - OSB Open Source Day 2019

Kubernetes on AWS @ Zalando Tech

Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...

How Zalando runs Kubernetes clusters at scale on AWS - AWS re:Invent

Microservices architecture: practical aspects

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - A...

2018 04-06 kubernetes ingress in production

IDI 2020 - Containers Meet Serverless

Red hat ansible automation technical deck

Kubernetes on AWS at Zalando: Failures & Learnings - DevOps NRW

Es-operator: Building an Elasticsearch Operator from the bottom up - kube-con...

AWS Dev Days Tour Germany - Berlin, Cologne, Munich, Frankfurt - Containers T...

AWS Summit Tel Aviv - Startup Track - Continuous Deployment

12.07.2017 Docker Meetup - KUBERNETES ON AWS @ ZALANDO TECH

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - C...

Better Software is Better than Worse Software - Michael Coté (Cape Town 2019)

From AWS/STUPS to Kubernetes on AWS @Zalando - Berlin Kubernetes Meetup

Recently uploaded

What is Augmented Reality Image Tracking

pavan998932

E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies

Quickdice ERP

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

Peter Muessig

The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.

Graspan: A Big Data System for Big Code Analysis

Aftab Hussain

We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs. We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations. These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18. - Accepted in ASPLOS ‘17, Xi’an, China. - Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17. - Invited for presentation at SoCal PLS ‘16. - Invited for poster presentation at PLDI SRC ‘16.

KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD

rodomar2

E-commerce Application Development Company.pdf

Hornet Dynamics

Using Xen Hypervisor for Functional Safety

Ayan Halder

E-commerce Development Services- Hornet Dynamics

Hornet Dynamics

Artificia Intellicence and XPath Extension Functions

Octavian Nadolu

SWEBOK and Education at FUSE Okinawa 2024

Hironori Washizaki

Oracle Database 19c New Features for DBAs and Developers.pptx

Remote DBA Services

openEuler Case Study - The Journey to Supply Chain Security

Shane Coughlan

ALGIT - Assembly Line for Green IT - Numbers, Data, Facts

Green Software Development

SMS API Integration in Saudi Arabia| Best SMS API Service

Yara Milbes

Discover the benefits and implementation of SMS API integration in the UAE and Middle East. This comprehensive guide covers the importance of SMS messaging APIs, the advantages of bulk SMS APIs, and real-world case studies. Learn how CEQUENS, a leader in communication solutions, can help your business enhance customer engagement and streamline operations with innovative CPaaS, reliable SMS APIs, and omnichannel solutions, including WhatsApp Business. Perfect for businesses seeking to optimize their communication strategies in the digital age.

原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样

mz5nrf0n

原版一模一样【微信：741003700 】【美国纽约州立大学奥尔巴尼分校毕业证学位证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma 1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700 留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才

Oracle 23c New Features For DBAs and Developers.pptx

Remote DBA Services

DDS-Security 1.2 - What's New? Stronger security for long-running systems

Gerardo Pardo-Castellote

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

Łukasz Chruściel

A Study of Variable-Role-based Feature Enrichment in Neural Models of Code

Aftab Hussain

Understanding variable roles in code has been found to be helpful by students in learning programming -- could variable roles help deep neural models in performing coding tasks? We do an exploratory study. - These are slides of the talk given at InteNSE'23: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, co-located with the 45th International Conference on Software Engineering, ICSE 2023, Melbourne Australia

Measures in SQL (SIGMOD 2024, Santiago, Chile)

Julian Hyde

SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries. SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL. To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context. A talk at SIGMOD, June 9–15, 2024, Santiago, Chile Authors: Julian Hyde (Google) and John Fremlin (Google) https://doi.org/10.1145/3626246.3653374

Recently uploaded (20)

What is Augmented Reality Image Tracking

E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

Graspan: A Big Data System for Big Code Analysis

KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD

E-commerce Application Development Company.pdf

Using Xen Hypervisor for Functional Safety

E-commerce Development Services- Hornet Dynamics

Artificia Intellicence and XPath Extension Functions

SWEBOK and Education at FUSE Okinawa 2024

Oracle Database 19c New Features for DBAs and Developers.pptx

openEuler Case Study - The Journey to Supply Chain Security

ALGIT - Assembly Line for Green IT - Numbers, Data, Facts

SMS API Integration in Saudi Arabia| Best SMS API Service

原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样

Oracle 23c New Features For DBAs and Developers.pptx

DDS-Security 1.2 - What's New? Stronger security for long-running systems

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

A Study of Variable-Role-based Feature Enrichment in Neural Models of Code

Measures in SQL (SIGMOD 2024, Santiago, Chile)

Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus

1. Cloud Native Infrastructure @Zalando Cloud Native Aarhus November 6th 2018 MIKKEL LARSEN @mikkeloscar 2018-11-06

2. 2 17 markets WE BRING FASHION TO PEOPLE IN 17 COUNTRIES 7 fulfillment centers 23 million active customers 4.5 billion € net sales 2017 200 million visits per month 15,000 employees in Europe

3. 3 ZALANDO TECH ~ 2.000 Employees in Tech ~ 300 Delivery teams

4. 4 SCALE 101Clusters 373Accounts

5. 5 INFRASTRUCTURE HISTORY @ ZALANDO STUPS (toolset around AWS) Kubernetes AWS accounts per team. All instances must run the same AMI. PowerUser access to Production. Clusters per product (multiple teams). Instances are not managed by teams. Hands off approach. You build it, you run EVERYTHING. A lot of stuff out of the box.

6. 6 KUBERNETES CLUSTER SETUP Master Config Worker EC2 Instances CloudFormation Stacks github.com/zalando-incubator/kubernetes-on-aws Master

7. 7 CLUSTER PROVISIONING CLUSTER LIFECYCLE MANAGER (CLM) ADMIN create apply manifests provision resources create CF stack CLUSTER REGISTRY CLM API ... ... ... CloudFormation API github.com/zalando-incubator/cluster-lifecycle-manager github.com/zalando-incubator/kubernetes-on-aws

8. 8 INGRESS https://github.com/zalando-incubator/kube-ingress-aws-controller

9. 9 STATEFUL WORKLOADS (POSTGRES)

10. 10 POSTGRES AS A SERVICE apiVersion: "acid.zalan.do/v1" kind: "postgresql" metadata: name: "test-cluster" namespace: "default" spec: teamId: "teapot" postgresql: version: "10" numberOfInstances: 3 volume: size: "10Gi"

11. 11 POSTGRES OPERATOR github.com/zalando-incubator/postgres-operator Node pg role=master Node pg role=replica Node pg role=replica Node postgres operator Evict ✘ evict pg role=replica promote role=masterrole=replica drain ✓

12. 12 POSTGRES OPERATOR github.com/zalando-incubator/postgres-operator apiVersion: policy/v1beta1 kind: PodDisruptionBudget metadata: name: "postgres-cluster" spec: minAvailable: 1 selector: matchLabels: application: “postgres-cluster” role: “master”

13. 13 CI/CD

14. 14 CONTINUOUS DELIVERY PLATFORM (CDP) BUILD PIPELINE GHE (pull-request) trigger push code push Build VMs Plain Ubuntu No credentials zone

15. 15 CONTINUOUS DELIVERY PLATFORM (CDP) BUILD DEFINITION RY MANAGER

16. 16 CONTINUOUS DELIVERY PLATFORM (CDP) BUILD OUTPUT RY MANAGER

17. 17 CONTINUOUS DELIVERY PLATFORM (CDP) DEPLOYMENT PIPELINE GHE deploytrigger push code (yaml) pull

18. 18 CONTINUOUS DELIVERY PLATFORM (CDP) DEPLOYMENT DEFINITION RY MANAGER

19. 19 CONTINUOUS DELIVERY PLATFORM (CDP) DEPLOYMENT OUTPUT RY MANAGER

20. 20 OBSERVABILITY

21. 21 OBSERVABILITY Ingress Logging daemon

22. 22 ZMON CHECKS github.com/zalando/zmon

23. 23 ZMON ALERTS github.com/zalando/zmon

24. 24 ZMON DASHBOARD github.com/zalando/zmon

25. 25 GRAFANA APPLICATION DASHBOARD

26. 26 AUTOSCALING

27. 27 CLUSTER AUTOSCALER 1a 1b 1c Node Pool: General purpose (m5.2xlarge) 1a 1b 1c Node Pool: GPU (p3.2xlarge) github.com/kubernetes/autoscaler + patches

28. 28 HORIZONTAL POD AUTOSCALING (CUSTOM METRICS) Queue Length Prometheus Query Ingress Req/s ZMON Check github.com/zalando-incubator/kube-metrics-adapter

29. 29 HORIZONTAL POD AUTOSCALING (CUSTOM METRICS) JOB SCALING TO CONSUME EVENTS (ZMON CHECK)

30. 30 OPEN SOURCE Cluster Lifecycle Manager github.com/zalando-incubator/cluster-lifecycle-manager Kubernetes on AWS github.com/zalando-incubator/kubernetes-on-aws AWS ALB Ingress controller github.com/zalando-incubator/kube-ingress-aws-controller Skipper HTTP Router & Ingress controller github.com/zalando/skipper External DNS github.com/kubernetes-incubator/external-dns Postgres Operator github.com/zalando-incubator/postgres-operator Kube Metrics Adapter github.com/zalando-incubator/kube-metrics-adapter

31. MIKKEL LARSEN mikkel.larsen@zalando.de @mikkeloscar Illustrations by @01k, @kcgreenn, @ntakayama 2018-07-12 SENIOR SOFTWARE ENGINEER PLATFORM INFRASTRUCTURE

Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus

Recommended

Recommended

More Related Content

What's hot

What's hot (12)

Similar to Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus

Similar to Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus (20)

Recently uploaded

Recently uploaded (20)

Cloud Native Infrastructure @ Zalando - Cloud Native Aarhus