Cloud in your Cloud

•

1 like•858 views

Cloud in your Cloud. How we use Microservices to build Digital Ocean's cloud platform. (GOphercon India conference 2016)

Software

How we build DigitalOcean
Cloud in your Cloud

About Me
• Technical Lead Digital Ocean 
• Microservices in GO Book
• Lives in Bangkok

Apps
Vertical Product
*dozen nodes*
• Customer Dashboard
• Community Site
• Cloud Api
• Billing
• VM Images
• VM Scheduler
• Server creation
• Metrics
• Monitoring
• Software Networking
Fleet Wide
*10,000(s) nodes*
• Metrics
Customer Hosted
*million(s) nodes*

Questions?
We’re Hiring!
Matthew Campbell
hyper@hyperworks.nu
@kanwisher
github.com/mattkanwisher

What's hot

Firebase Cloud Functions: a quick overviewJoseph Lust

Cloudsolutionday 2016: Docker & FAAS at getvero.comAWS Vietnam Community

Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein,...HostedbyConfluent

My graduation project on Opsschool ('the elephant')Liora Kamil

From AWS to GCP, TABLEAPP Architecture StoryYen-Wen Chen

Journey to the cloudMikhail Advani

Azure Cosmos DB Kafka Connectors | Abinav Rameesh, MicrosoftHostedbyConfluent

Practical CloudLynn Langit

Serverless with Google Cloud FunctionsJerry Jalava

Михаил Максимов ( Software engineer, DataArt. AWS certified Solution Architect)DataArt

Serverless Apps on Google Cloud: more dev, less opsJoseph Lust

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...HostedbyConfluent

Continuously delivered scalable geoserviesDaniel Fenton

Serverless RealityLynn Langit

Embracing Serverless with GoogleJoseph Lust

Spotify's journey to GCPAlexey Lapitsky

Tableapp architecture migration story for GCPUG.TWYen-Wen Chen

Zero to Serverless in 60s - AnywhereBrian Christner

Cognos tm1 Online TrainingNagendra Kumar

Google cloud functionsPéter Nagy

What's hot (20)

Firebase Cloud Functions: a quick overview

Cloudsolutionday 2016: Docker & FAAS at getvero.com

Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein,...

My graduation project on Opsschool ('the elephant')

From AWS to GCP, TABLEAPP Architecture Story

Journey to the cloud

Azure Cosmos DB Kafka Connectors | Abinav Rameesh, Microsoft

Practical Cloud

Serverless with Google Cloud Functions

Михаил Максимов ( Software engineer, DataArt. AWS certified Solution Architect)

Serverless Apps on Google Cloud: more dev, less ops

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

Continuously delivered scalable geoservies

Serverless Reality

Embracing Serverless with Google

Spotify's journey to GCP

Tableapp architecture migration story for GCPUG.TW

Zero to Serverless in 60s - Anywhere

Cognos tm1 Online Training

Google cloud functions

Similar to Cloud in your Cloud

Forced Evolution: Shopify's Journey to KubernetesC4Media

Designing microservicesMasashi Narumoto

GCP Meetup #3 - Approaches to Cloud Native Architecturesnine

Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...confluent

stackconf 2020 | The path to a Serverless-native era with Kubernetes by Paolo...NETWAYS

Building a Service Mesh with NGINX Owen Garrett.pptxPINGXIONG3

Data Streaming with Apache Kafka & MongoDBconfluent

Kubernetes, Istio e Knative: The new cloud stackLuram Archanjo

Azure and web sites hackaton deckAlexey Bokov

How to Manage Your Cloud by Drupal (DrupalCon CPH 2010)DOCOMO Innovations, Inc.

Building Microservices with gRPC and NATSShiju Varghese

Serverless Framework IntroNikolaus Graf

The path to a serverless-native era with Kubernetessparkfabrik

Track 4 Session 3_ 利用 AWS Step Functions 建構穩健的業務處理流程Amazon Web Services

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...Codit

Azure Serverless ToolboxJohan Eriksson

GO and GCP: IntroductionViktor Pakhuchyi

Un-clouding the cloudDavinder Kohli

Real Time Data Visualization using asp.net / SignalR + D3.jsSunny Sharma

Introducing ONAP for OpenStack St Louis Meetupdjzook

Similar to Cloud in your Cloud (20)

Forced Evolution: Shopify's Journey to Kubernetes

Designing microservices

GCP Meetup #3 - Approaches to Cloud Native Architectures

Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...

stackconf 2020 | The path to a Serverless-native era with Kubernetes by Paolo...

Building a Service Mesh with NGINX Owen Garrett.pptx

Data Streaming with Apache Kafka & MongoDB

Kubernetes, Istio e Knative: The new cloud stack

Azure and web sites hackaton deck

How to Manage Your Cloud by Drupal (DrupalCon CPH 2010)

Building Microservices with gRPC and NATS

Serverless Framework Intro

The path to a serverless-native era with Kubernetes

Track 4 Session 3_ 利用 AWS Step Functions 建構穩健的業務處理流程

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...

Azure Serverless Toolbox

GO and GCP: Introduction

Un-clouding the cloud

Real Time Data Visualization using asp.net / SignalR + D3.js

Introducing ONAP for OpenStack St Louis Meetup

Recently uploaded

chapter--4-software-project-planning.pptkotipi9215

办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea

Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran

Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.

BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp

Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin

React Server Component in Next.js by Hanief UtamaHanief Utama

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.

Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH

Professional Resume Template for Software DevelopersVinodh Ram

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.

Implementing Zero Trust strategy with AzureDinusha Kumarasiri

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app

Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110

What is Fashion PLM and Why Do You Need ItWave PLM

Cloud Data Center Network Construction - IEEEVICTOR MAESTRE RAMIREZ

GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko

EY_Graph Database Powered SustainabilityNeo4j

Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz

Recently uploaded (20)

chapter--4-software-project-planning.ppt

办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样

Intelligent Home Wi-Fi Solutions | ThinkPalm

Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...

BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

React Server Component in Next.js by Hanief Utama

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Der Spagat zwischen BIAS und FAIRNESS (2024)

Professional Resume Template for Software Developers

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Implementing Zero Trust strategy with Azure

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...

What is Fashion PLM and Why Do You Need It

Cloud Data Center Network Construction - IEEE

GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf

EY_Graph Database Powered Sustainability

Folding Cheat Sheet #4 - fourth in a series

Cloud in your Cloud

1. How we build DigitalOcean Cloud in your Cloud

2. About Me • Technical Lead Digital Ocean  • Microservices in GO Book • Lives in Bangkok 

3. Apps Vertical Product *dozen nodes* • Customer Dashboard • Community Site • Cloud Api • Billing • VM Images • VM Scheduler • Server creation • Metrics • Monitoring • Software Networking Fleet Wide *10,000(s) nodes* • Metrics Customer Hosted *million(s) nodes*

5. Build

6. Monorepo

7. Pull Request Driven development

8. Service Discovery

9. Consul Dashboard

10.

11. Consul Replication Regions

12. DNS SRV vs API For discovery

13. Deploy

14. Artifacts Created on every build

15. Instead of branches Feature Flags

16. With Chef Incremental Rollout