Netflix Container Runtime - Titus - for Container Camp 2016

•

10 likes•4,784 views

aspyker

Lightning talk on Netflix Titus 4/2016.

Technology

Netflix Container Cloud
Container Camp, April 2016
Andrew Spyker @aspyker
Andrew Leung @anwleung

Titus at High Level
Service Batch
Job Management
Elastic Resource Management & Optimization
Container Execution
Integration
AdhocMVP’s
2

Titus UITitus UI
Docker
Registry
Docker
Registry
Titus High Level Architecture
Rhea
container
container
container
docker
Titus Agent
metrics agent
Titus executor
logging agent
zfs
mesos agent
docker
RheaTitus API
Cassandra
Titus Master
Job Management &
Scheduler
S3
Zookeeper
Docker
Registry
3
EC2 Autocaling
API
Mesos Master
Titus UI
Fenzo
VPC networking
driver
containercontainer
container
AWS container
metadata proxy
Integration
CI/CD
Amazon VM’s

Current Titus Numbers
● Autoscaling 100’s of r3.8xl’s
○ Each 32 vCPU, 244G
● Peak
○ Thousands of cores
○ Tens of TB’s memory
● Thousands containers/day
● ~ 100 different images
4

What's hot

Container Orchestration with Docker Swarm and KubernetesWill Hall

Container orchestration overviewWyn B. Van Devanter

Sf bay area Kubernetes meetup dec8 2016 - deployment modelsPeter Ss

Monitoring Docker at Scale - Docker San Francisco Meetup - August 11, 2015Datadog

NetflixOSS meetup lightning talks and roadmapRuslan Meshenberg

NetflixOSS Meetup S6E2 - Spinnaker, Kayentaaspyker

AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...Amazon Web Services

Proactive ops for container orchestration environmentsDocker, Inc.

MicroServices at Netflix - challenges of scaleSudhir Tonse

Netflix Open Source Meetup Season 4 Episode 3aspyker

[Spark Summit 2017 NA] Apache Spark on KubernetesTimothy Chen

Monitoring Docker containers - Docker NYC Feb 2015Datadog

Stranger Things: The Forces that Disrupt NetflixC4Media

Aws + kubernetes = ❤︎Anthony Stanton

The Tale of Two Deployments: Greenfield and Monolith Apps with Docker Enterpr...Docker, Inc.

Cloud spanner architecture and use casesGDG Cloud Bengaluru

Fact-Based Monitoring - PuppetConf 2014Puppet

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015Datadog

GKE Tip Series how do i choose between gke standard, autopilot and cloud run Sreenivas Makam

Virtualization at Gilt - Rangarajan RadhakrishnanDatadog

What's hot (20)

Container Orchestration with Docker Swarm and Kubernetes

Container orchestration overview

Sf bay area Kubernetes meetup dec8 2016 - deployment models

Monitoring Docker at Scale - Docker San Francisco Meetup - August 11, 2015

NetflixOSS meetup lightning talks and roadmap

NetflixOSS Meetup S6E2 - Spinnaker, Kayenta

AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...

Proactive ops for container orchestration environments

MicroServices at Netflix - challenges of scale

Netflix Open Source Meetup Season 4 Episode 3

[Spark Summit 2017 NA] Apache Spark on Kubernetes

Monitoring Docker containers - Docker NYC Feb 2015

Stranger Things: The Forces that Disrupt Netflix

Aws + kubernetes = ❤︎

The Tale of Two Deployments: Greenfield and Monolith Apps with Docker Enterpr...

Cloud spanner architecture and use cases

Fact-Based Monitoring - PuppetConf 2014

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

GKE Tip Series how do i choose between gke standard, autopilot and cloud run

Virtualization at Gilt - Rangarajan Radhakrishnan

Similar to Netflix Container Runtime - Titus - for Container Camp 2016

Netflix and Containers: Not A Stranger Thingaspyker

Netflix and Containers: Not Stranger ThingsAll Things Open

Container and Microservice MeetupAndrew Leung

AWS re:Invent 2016: Netflix: Container Scheduling, Execution, and Integration...Amazon Web Services

Netflix Titus WASP October 2017Andrew Leung

Netflix Container Scheduling and Execution - QCon New York 2016aspyker

Scheduling a fuller house - Talk at QCon NY 2016Sharma Podila

reInvent 2021 Recap and k9s reviewFaheem Memon

Podila QCon SF 2016Sharma Podila

Docker clusters on AWS with Amazon ECS and KubernetesJulien SIMON

Unleashing k8 s to reduce complexities of an entire middleware platformLakmal Warusawithana

Intro to batch processing on AWSAmazon Web Services

Bitbucket Pipelines - Powered by KubernetesNathan Burrell

AWS re:Invent 2016: Introduction to Container Management on AWS (CON303)Amazon Web Services

Intro to Batch Processing on AWS - DevDay Los Angeles 2017Amazon Web Services

AWS reinvent 2019 recap - Riyadh - Containers and Serverless - Paul MaddoxAWS Riyadh User Group

Disenchantment: Netflix Titus, Its Feisty Team, and DaemonsC4Media

Scaling Jenkins with Docker and KubernetesCarlos Sanchez

Introduction to Docker on AWSAmazon Web Services

Batch Processing with Containers on AWS - June 2017 AWS Online Tech TalksAmazon Web Services

Similar to Netflix Container Runtime - Titus - for Container Camp 2016 (20)

Netflix and Containers: Not A Stranger Thing

Netflix and Containers: Not Stranger Things

Container and Microservice Meetup

AWS re:Invent 2016: Netflix: Container Scheduling, Execution, and Integration...

Netflix Titus WASP October 2017

Netflix Container Scheduling and Execution - QCon New York 2016

Scheduling a fuller house - Talk at QCon NY 2016

reInvent 2021 Recap and k9s review

Podila QCon SF 2016

Docker clusters on AWS with Amazon ECS and Kubernetes

Unleashing k8 s to reduce complexities of an entire middleware platform

Intro to batch processing on AWS

Bitbucket Pipelines - Powered by Kubernetes

AWS re:Invent 2016: Introduction to Container Management on AWS (CON303)

Intro to Batch Processing on AWS - DevDay Los Angeles 2017

AWS reinvent 2019 recap - Riyadh - Containers and Serverless - Paul Maddox

Disenchantment: Netflix Titus, Its Feisty Team, and Daemons

Scaling Jenkins with Docker and Kubernetes

Introduction to Docker on AWS

Batch Processing with Containers on AWS - June 2017 AWS Online Tech Talks

Recently uploaded

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10

Real Time Object Detection Using Open CVKhem

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbuapidays

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93

Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun

ICT role in 21st century education and its challengesrafiqahmad00786416

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung

Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

A Year of the Servo Reboot: Where Are We Now?Igalia

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays

DBX First Quarter 2024 Investor PresentationDropbox

2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

Corporate and higher education May webinar.pptxRustici Software

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Real Time Object Detection Using Open CV

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Powerful Google developer tools for immediate impact! (2023-24 C)

ICT role in 21st century education and its challenges

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

A Year of the Servo Reboot: Where Are We Now?

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

DBX First Quarter 2024 Investor Presentation

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

A Beginners Guide to Building a RAG App Using Open Source Milvus

Automating Google Workspace (GWS) & more with Apps Script

Corporate and higher education May webinar.pptx

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Netflix Container Runtime - Titus - for Container Camp 2016

1. Netflix Container Cloud Container Camp, April 2016 Andrew Spyker @aspyker Andrew Leung @anwleung

2. Titus at High Level Service Batch Job Management Elastic Resource Management & Optimization Container Execution Integration AdhocMVP’s 2

3. Titus UITitus UI Docker Registry Docker Registry Titus High Level Architecture Rhea container container container docker Titus Agent metrics agent Titus executor logging agent zfs mesos agent docker RheaTitus API Cassandra Titus Master Job Management & Scheduler S3 Zookeeper Docker Registry 3 EC2 Autocaling API Mesos Master Titus UI Fenzo VPC networking driver containercontainer container AWS container metadata proxy Integration CI/CD Amazon VM’s

4. Current Titus Numbers ● Autoscaling 100’s of r3.8xl’s ○ Each 32 vCPU, 244G ● Peak ○ Thousands of cores ○ Tens of TB’s memory ● Thousands containers/day ● ~ 100 different images 4

5. Questions? 5

Netflix Container Runtime - Titus - for Container Camp 2016

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Netflix Container Runtime - Titus - for Container Camp 2016

Similar to Netflix Container Runtime - Titus - for Container Camp 2016 (20)

More from aspyker

More from aspyker (20)

Recently uploaded

Recently uploaded (20)

Netflix Container Runtime - Titus - for Container Camp 2016