CoreOS @ summer meetup in Utrecht

•

5 likes•2,184 views

Timo Derstappen

Giant Swarm
● Simple Service Orchestration
● Based in Cologne, Germany
● Built on top of CoreOS
http://giantswarm.io

● Minimal OS to host your containers
● Automatic Updates
● Cluster Management
● Service Discovery

CoreOS 101
● Minimal Gentoo
● PXE, OpenStack, AWS, GCE, Vagrant
● Systemd, btrfs
● Read-only rootfs (writable overlay)

CoreOS own tools
● Etcd
● Fleet
● Locksmith
● Cloud-config
github.com/coreos

Etcd
● Highly available K/V store
● Basis for
○ Configuration management
○ Service Discovery
● Raft consensus algorithm
● REST Interface

Discovery API
$ curl https://discovery.etcd.io/new
https://discovery.etcd.
io/463c1435f9f63c952e0899b1f459c0fe

Cloud Config
● Initialization of your instances
● Configure etcd, fleet, locksmith

Configure your cluster
#cloud-config
coreos:
etcd:
discovery: https://discovery.etcd.io/<token>
addr: $private_ipv4:4001
peer-addr: $private_ipv4:7001

Locksmith
● Reboot strategies for CoreOS updates
● Uses etcd for distributed locks

Fleet
● Fleet is systemd for the cluster
● Uses etcd
● CLI and API to start your containers

Fleet Scheduler
● Simple (eg. based on Metadata)
● But resolves service dependencies!
● More to come (eg. based on available
resources)

Unit file
[Unit]
Description=A Redis Server
[Service]
TimeoutStartSec=0
EnvironmentFile=/etc/environment
Environment="IMAGE=teemow/redis"
ExecStartPre=/usr/bin/docker pull $IMAGE
ExecStart=/bin/bash -c "exec /usr/bin/docker run --rm -p
$COREOS_PRIVATE_IPV4::6379 --name %n $IMAGE"
ExecStop=/usr/bin/docker stop %n

Launch a service
# start
fleetctl start redis.service
# status
fleetctl list-units
fleetctl status redis.service
fleetctl journal redis.service
# stop
fleetctl stop redis.service
fleetctl destroy redis.service

Release it!
● Load Balancer
● App
● Database

Sidekick
● Keep
configuration out
of your app

Ambassador
● Reverse proxy for
your service
● Keep service
discovery out of
your app

CoreOS
● Great foundation to create flexible distributed
infrastructures
● Unix philosophy

Thanks for listening!
Timo Derstappen
@teemow
http://giantswarm.io

What's hot

AtlasCamp 2015: The age of orchestration: From Docker basics to cluster manag...Atlassian

Container orchestrationTimo Derstappen

Container-relevant Upstream Kernel DevelopmentsDocker, Inc.

Docker orchestration using core os and ansible - Ansible IL 2015Leonid Mirsky

Endocode Kubernetes Meetup: Architecture Patterns for Microservices in Kubern...Thomas Fricke

Containerd Internals: Building a Core Container RuntimePhil Estes

runC: The little engine that could (run Docker containers) by Docker Captain ...Docker, Inc.

Docker 1.11 @ Docker SF MeetupDocker, Inc.

Driving containerd operations with gRPCDocker, Inc.

AtlasCamp 2015: How to deliver radical architectural change without the custo...Atlassian

Stateful Containers: Flocker on CoreOSStephen Nguyen

Using linuxKit to build custom rancherOS systems Moby Project

Kubernetes Architecture and Introduction – Paris Kubernetes MeetupStefan Schimanski

Hands On Gluster with Jeff DarcyGluster.org

CoreOS @Codetalks HamburgTimo Derstappen

Breaking the RpiDocker challenge Nicolas De Loof

Scalability and Performance of CNS 3.6Gluster.org

Docker Swarm 0.2.0Docker, Inc.

LinuxKit Swarm NodesMoby Project

GDG Lima - Docker ComposeMario IC

What's hot (20)

AtlasCamp 2015: The age of orchestration: From Docker basics to cluster manag...

Container orchestration

Container-relevant Upstream Kernel Developments

Docker orchestration using core os and ansible - Ansible IL 2015

Endocode Kubernetes Meetup: Architecture Patterns for Microservices in Kubern...

Containerd Internals: Building a Core Container Runtime

runC: The little engine that could (run Docker containers) by Docker Captain ...

Docker 1.11 @ Docker SF Meetup

Driving containerd operations with gRPC

AtlasCamp 2015: How to deliver radical architectural change without the custo...

Stateful Containers: Flocker on CoreOS

Using linuxKit to build custom rancherOS systems

Kubernetes Architecture and Introduction – Paris Kubernetes Meetup

Hands On Gluster with Jeff Darcy

CoreOS @Codetalks Hamburg

Breaking the RpiDocker challenge

Scalability and Performance of CNS 3.6

Docker Swarm 0.2.0

LinuxKit Swarm Nodes

GDG Lima - Docker Compose

Viewers also liked

Giant Swarm @Devhouse fridayTimo Derstappen

Eine Einführung in DockerMatthias Luebken

Kubernetes Frankfurtloodse

Kubernetes Workshoploodse

OpenStack und Containersinovex GmbH

Docker meets Kubernetesloodse

CoreOS入門Yutaka Matsubara

Viewers also liked (7)

Giant Swarm @Devhouse friday

Eine Einführung in Docker

Kubernetes Frankfurt

Kubernetes Workshop

OpenStack und Containers

Docker meets Kubernetes

CoreOS入門

Similar to CoreOS @ summer meetup in Utrecht

CoreOS introTimo Derstappen

Start tracking your ruby infrastructureSergiy Kukunin

Real World Experience of Running Docker in Development and ProductionBen Hall

Kubered -Recipes for C2 Operations on KubernetesJeffrey Holden

[EXTENDED] Ceph, Docker, Heroku Slugs, CoreOS and Deis OverviewLeo Lorieri

Docker, c'est bonheur !Alexandre Salomé

Running Docker in Development & Production (#ndcoslo 2015)Ben Hall

ILM - Pipeline in the cloudAaron Carey

Scaling Docker Containers using Kubernetes and Azure Container ServiceBen Hall

TIAD 2016 : Migrating 100% of your production services to containersThe Incredible Automation Day

Scaling docker with kubernetesLiran Cohen

Introction to docker swarmHsi-Kai Wang

JDO 2019: Tips and Tricks from Docker Captain - Łukasz LachPROIDEA

Docker slidesAyla Khan

CoreOS : 설치부터 컨테이너 배포까지충섭 김

CoreOS, or How I Learned to Stop Worrying and Love SystemdRichard Lister

Create a Database Application Development Environment with DockerBlaine Carter

Running .NET on DockerBen Hall

Docker Security workshop slidesDocker, Inc.

Develop QNAP NAS App by DockerTerry Chen

Similar to CoreOS @ summer meetup in Utrecht (20)

CoreOS intro

Start tracking your ruby infrastructure

Real World Experience of Running Docker in Development and Production

Kubered -Recipes for C2 Operations on Kubernetes

[EXTENDED] Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview

Docker, c'est bonheur !

Running Docker in Development & Production (#ndcoslo 2015)

ILM - Pipeline in the cloud

Scaling Docker Containers using Kubernetes and Azure Container Service

TIAD 2016 : Migrating 100% of your production services to containers

Scaling docker with kubernetes

Introction to docker swarm

JDO 2019: Tips and Tricks from Docker Captain - Łukasz Lach

Docker slides

CoreOS : 설치부터 컨테이너 배포까지

CoreOS, or How I Learned to Stop Worrying and Love Systemd

Create a Database Application Development Environment with Docker

Running .NET on Docker

Docker Security workshop slides

Develop QNAP NAS App by Docker

CoreOS @ summer meetup in Utrecht

1. Timo Derstappen @teemow

2. Giant Swarm ● Simple Service Orchestration ● Based in Cologne, Germany ● Built on top of CoreOS http://giantswarm.io

3. ● Minimal OS to host your containers ● Automatic Updates ● Cluster Management ● Service Discovery

4. CoreOS 101 ● Minimal Gentoo ● PXE, OpenStack, AWS, GCE, Vagrant ● Systemd, btrfs ● Read-only rootfs (writable overlay)

5. CoreOS own tools ● Etcd ● Fleet ● Locksmith ● Cloud-config github.com/coreos

6. Etcd ● Highly available K/V store ● Basis for ○ Configuration management ○ Service Discovery ● Raft consensus algorithm ● REST Interface

7. Discovery API $ curl https://discovery.etcd.io/new https://discovery.etcd. io/463c1435f9f63c952e0899b1f459c0fe

8. Cloud Config ● Initialization of your instances ● Configure etcd, fleet, locksmith

9. Configure your cluster #cloud-config coreos: etcd: discovery: https://discovery.etcd.io/<token> addr: $private_ipv4:4001 peer-addr: $private_ipv4:7001

10. Locksmith ● Reboot strategies for CoreOS updates ● Uses etcd for distributed locks

11. Fleet ● Fleet is systemd for the cluster ● Uses etcd ● CLI and API to start your containers

12. Fleet Scheduler ● Simple (eg. based on Metadata) ● But resolves service dependencies! ● More to come (eg. based on available resources)

13. Unit file [Unit] Description=A Redis Server [Service] TimeoutStartSec=0 EnvironmentFile=/etc/environment Environment="IMAGE=teemow/redis" ExecStartPre=/usr/bin/docker pull $IMAGE ExecStart=/bin/bash -c "exec /usr/bin/docker run --rm -p $COREOS_PRIVATE_IPV4::6379 --name %n $IMAGE" ExecStop=/usr/bin/docker stop %n

14. Launch a service # start fleetctl start redis.service # status fleetctl list-units fleetctl status redis.service fleetctl journal redis.service # stop fleetctl stop redis.service fleetctl destroy redis.service

15. Release it! ● Load Balancer ● App ● Database

16. Sidekick ● Keep configuration out of your app

17. Ambassador ● Reverse proxy for your service ● Keep service discovery out of your app

18. CoreOS ● Great foundation to create flexible distributed infrastructures ● Unix philosophy

19. Thanks for listening! Timo Derstappen @teemow http://giantswarm.io

CoreOS @ summer meetup in Utrecht

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to CoreOS @ summer meetup in Utrecht

Similar to CoreOS @ summer meetup in Utrecht (20)

CoreOS @ summer meetup in Utrecht