© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Introducing Mesos Environments in
Rancher
June 29, 2016
#ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Shannon Williams
Co-Founder/VP Marketing
@smw355
1
Darren Shepherd
Co-Founder/Chief Architect
@ibuildthecloud
Freenode: darren0
#ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
First things first…
This is a not a !
2 #ranchermeetup
© 2015 Rancher Labs, Inc.3
There are rules for a meetup!
• We won’t be done on time
• Questions are always welcome
• There are no bad questions
• Demo, then demo some more
• Things will break, be patient
#ranchermeetup
© 2015 Rancher Labs, Inc.4
Join the conversation on Twitter
#ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Agenda
• Introducing Mesos Environments in Rancher - Shannon
• Demo: Deploying Mesos – Darren
• Demo: Deploying Frameworks – Darren
• Latest Rancher Update – Darren
5 #ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
DockerCon Update
• Built-in container
orchestration introduced in
Docker 1.12
• New Distributed Application
Bundle format
• New Docker Store
6
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Rancher Labs
7 #ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Private Container Service
8
Applications
Orchestration
Infrastructure
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Deploy and Manage Infrastructure
9
Environment: Dev-Lab
Network Services Storage Services
Host 1 Host 2 Host 3 Host n
Infrastructure
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Select an Orchestration Tool
10
Environment: Dev-Lab
Host 1 Host 2 Host 3 Host n
Network Services Storage Services
Orchestration
Kubernetes System Services
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Launch Applications and Services
11
Environment: Dev-Lab
Host 1 Host 2 Host 3 Host n
Network Services Storage Services
Orchestration
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Launch Applications and Services
12
Environment: Dev-Lab
Host 1 Host 2 Host 3 Host n
Network Services Storage Services
Orchestration
Delivery Pipeline docker-compose.yml
lb:
image: haproxy
links:
- web
tomcat:
image: tomcat
links:
- mysqlv1
- redis
redis:
image: redis
mysqlv1:
image: mysql
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
- 1 Million+ Downloads
- 1.0 Released in March
- Open Source
- Multi-tenant
- Enterprise Support
13
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .#ranchermeetup
Introducing
Mesos
Environments
in Rancher
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
What is Apache Mesos?
- Open Source Cluster
Manager written in C++
- Frameworks provide
interface for deploying
workloads
- Started in 2009 at UC
Berkeley
- Well known users include
Twitter, AirBNB, Apple
- Current stable release is
0.28
15
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Mesos Environments in Rancher
16
• Automated deployment of an unlimited
number of Mesos clusters
• Lifecycle management of Mesos clusters
• Control user access to Mesos
environments
• Mesos framework deployment from catalog
• Node provisioning through Docker Machine
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Inside a Rancher Mesos Environment
17
Environment A
Mesos Master 1 Mesos Master 2 Mesos Master 3
Mesos Slave 1 Mesos Slave 2 Mesos Slave 3
Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4
Mesos
System
Services
• Slaves send resource availability to masters.
• Masters publish offers of resources.
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .18
Mesos Environments
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .19
Mesos Control Plane
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .20
Mesos Frameworks
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .21
• Frameworks are how users
submit jobs to the Mesos cluster
• Different types of frameworks for
specific use cases
• Popular frameworks include
Marathon, Chronos, Aurora,
Spark, Kafka, etc.
• Frameworks include schedulers
and executors
• Rancher deploys and manages
frameworks as Docker
containers
Mesos Frameworks
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Deploying Frameworks in Rancher
22
Environment A
Mesos Master 1 Mesos Master 2 Mesos Master 3
Mesos Slave 1 Mesos Slave 2 Mesos Slave 3
Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4
Mesos
System
Services
Marathon
Mesos
Frameworks Chronos
• Slaves send resource availability to masters
• Masters publish offers of resources.
• Frameworks accept/reject offers, and sends tasks.
• Tasks are executed by slaves running framework executor.
App App App
© 2015 Rancher Labs, Inc.23
Demo
#ranchermeetup
© 2015 Rancher Labs, Inc.
Latest Rancher Enhancements
24
1.1.0 - Today
New Features (since v1.1.0-dev5)
Docker 1.11.x Support
Microsoft Azure AD Support
Kubernetes: SSL Support (self-signed)
New Features (since v1.0.2)
Machine Catalog
Custom UI for Machine Drivers
Kubernetes: Persistent Storage from EBS and GCE
Kubernetes: Private Registry
Kubernetes: Upgrade
Kubernetes: Ingress controller improvements
Support for Internationalization framework for UI
Mesos Support
Support for External Load Balancers (F5 initial release)
Experimental: Vault Integration
#ranchermeetup
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Getting Started
Rancher and RancherOS are in GitHub – Get Involved!
25 #ranchermeetup
http://github.com/rancher
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
New eBook: Building a CI/CD Pipeline
with Docker & Rancher
26
http://info.rancher.com/cicd-with-docker-ebook
© 2015 Rancher Labs, Inc.© 2016 Rancher Labs, Inc .
Thank you
rancher.com
#ranchermeetup

Introducing Apache Mesos environments in Rancher - June 2016 Online Meetup

  • 1.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Introducing Mesos Environments in Rancher June 29, 2016 #ranchermeetup
  • 2.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Shannon Williams Co-Founder/VP Marketing @smw355 1 Darren Shepherd Co-Founder/Chief Architect @ibuildthecloud Freenode: darren0 #ranchermeetup
  • 3.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . First things first… This is a not a ! 2 #ranchermeetup
  • 4.
    © 2015 RancherLabs, Inc.3 There are rules for a meetup! • We won’t be done on time • Questions are always welcome • There are no bad questions • Demo, then demo some more • Things will break, be patient #ranchermeetup
  • 5.
    © 2015 RancherLabs, Inc.4 Join the conversation on Twitter #ranchermeetup
  • 6.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Agenda • Introducing Mesos Environments in Rancher - Shannon • Demo: Deploying Mesos – Darren • Demo: Deploying Frameworks – Darren • Latest Rancher Update – Darren 5 #ranchermeetup
  • 7.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . DockerCon Update • Built-in container orchestration introduced in Docker 1.12 • New Distributed Application Bundle format • New Docker Store 6
  • 8.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Rancher Labs 7 #ranchermeetup
  • 9.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Private Container Service 8 Applications Orchestration Infrastructure
  • 10.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Deploy and Manage Infrastructure 9 Environment: Dev-Lab Network Services Storage Services Host 1 Host 2 Host 3 Host n Infrastructure
  • 11.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Select an Orchestration Tool 10 Environment: Dev-Lab Host 1 Host 2 Host 3 Host n Network Services Storage Services Orchestration Kubernetes System Services
  • 12.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Launch Applications and Services 11 Environment: Dev-Lab Host 1 Host 2 Host 3 Host n Network Services Storage Services Orchestration
  • 13.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Launch Applications and Services 12 Environment: Dev-Lab Host 1 Host 2 Host 3 Host n Network Services Storage Services Orchestration Delivery Pipeline docker-compose.yml lb: image: haproxy links: - web tomcat: image: tomcat links: - mysqlv1 - redis redis: image: redis mysqlv1: image: mysql
  • 14.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . - 1 Million+ Downloads - 1.0 Released in March - Open Source - Multi-tenant - Enterprise Support 13
  • 15.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc .#ranchermeetup Introducing Mesos Environments in Rancher
  • 16.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . What is Apache Mesos? - Open Source Cluster Manager written in C++ - Frameworks provide interface for deploying workloads - Started in 2009 at UC Berkeley - Well known users include Twitter, AirBNB, Apple - Current stable release is 0.28 15
  • 17.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Mesos Environments in Rancher 16 • Automated deployment of an unlimited number of Mesos clusters • Lifecycle management of Mesos clusters • Control user access to Mesos environments • Mesos framework deployment from catalog • Node provisioning through Docker Machine
  • 18.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Inside a Rancher Mesos Environment 17 Environment A Mesos Master 1 Mesos Master 2 Mesos Master 3 Mesos Slave 1 Mesos Slave 2 Mesos Slave 3 Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4 Mesos System Services • Slaves send resource availability to masters. • Masters publish offers of resources.
  • 19.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc .18 Mesos Environments
  • 20.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc .19 Mesos Control Plane
  • 21.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc .20 Mesos Frameworks
  • 22.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc .21 • Frameworks are how users submit jobs to the Mesos cluster • Different types of frameworks for specific use cases • Popular frameworks include Marathon, Chronos, Aurora, Spark, Kafka, etc. • Frameworks include schedulers and executors • Rancher deploys and manages frameworks as Docker containers Mesos Frameworks
  • 23.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Deploying Frameworks in Rancher 22 Environment A Mesos Master 1 Mesos Master 2 Mesos Master 3 Mesos Slave 1 Mesos Slave 2 Mesos Slave 3 Zookeeper 1 Zookeeper 2 Zookeeper 3 Mesos Slave 4 Mesos System Services Marathon Mesos Frameworks Chronos • Slaves send resource availability to masters • Masters publish offers of resources. • Frameworks accept/reject offers, and sends tasks. • Tasks are executed by slaves running framework executor. App App App
  • 24.
    © 2015 RancherLabs, Inc.23 Demo #ranchermeetup
  • 25.
    © 2015 RancherLabs, Inc. Latest Rancher Enhancements 24 1.1.0 - Today New Features (since v1.1.0-dev5) Docker 1.11.x Support Microsoft Azure AD Support Kubernetes: SSL Support (self-signed) New Features (since v1.0.2) Machine Catalog Custom UI for Machine Drivers Kubernetes: Persistent Storage from EBS and GCE Kubernetes: Private Registry Kubernetes: Upgrade Kubernetes: Ingress controller improvements Support for Internationalization framework for UI Mesos Support Support for External Load Balancers (F5 initial release) Experimental: Vault Integration #ranchermeetup
  • 26.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Getting Started Rancher and RancherOS are in GitHub – Get Involved! 25 #ranchermeetup http://github.com/rancher
  • 27.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . New eBook: Building a CI/CD Pipeline with Docker & Rancher 26 http://info.rancher.com/cicd-with-docker-ebook
  • 28.
    © 2015 RancherLabs, Inc.© 2016 Rancher Labs, Inc . Thank you rancher.com #ranchermeetup