0
Apache Mesos
●

What is it ?

●

Beyond Hadoop

●

Resource Sharing

●

Mesos Intentions

●

Architecture

●

Users

www.s...
Apache Mesos – What is it ?
●

A cluster manager

●

Provides resource isolation / sharing

●

Run distributed systems on ...
Apache Mesos – What is it ?
●

Its fault tolerant
–

●

Leader election via Zoo Keeper

Multi platform
–

Linux , OSX , Op...
Apache Mesos – Beyond Hadoop
What requirements are there beyond Hadoop ?
●

Cluster sharing / multi tenancy

●

Higher res...
Apache Mesos – Resource Sharing

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz
Apache Mesos – Intentions
●

Avoid multiple specialised clusters

●

Avoid the need for “silo'ed” clusters

●

Avoid the l...
Apache Mesos – Architecture

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz
Apache Mesos – Users
Companies using Mesos
●

Air bnb

●

Cloud Physics

●

HubSpot

●

Shopify

●

Twitter

●

Vimeo

●

...
Contact Us
●

Feel free to contact us at
–

www.semtech-solutions.co.nz

–

info@semtech-solutions.co.nz

●

We offer IT p...
Contact Us
●

Feel free to contact us at
–

www.semtech-solutions.co.nz

–

info@semtech-solutions.co.nz

●

We offer IT p...
Upcoming SlideShare
Loading in...5
×

An introduction to Apache Mesos

665

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
665
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "An introduction to Apache Mesos"

  1. 1. Apache Mesos ● What is it ? ● Beyond Hadoop ● Resource Sharing ● Mesos Intentions ● Architecture ● Users www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  2. 2. Apache Mesos – What is it ? ● A cluster manager ● Provides resource isolation / sharing ● Run distributed systems on the same pool of nodes – Hadoop, Spark, Storm, Jenkins, K ... ● Cluster monitoring via web UI ● Tasks isolated via Linux Containers ● Scalable – 10k's ● Written in C++ ● C++/Java/Python API's for new app dev www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  3. 3. Apache Mesos – What is it ? ● Its fault tolerant – ● Leader election via Zoo Keeper Multi platform – Linux , OSX , Open Solaris ● It is now a full Apache project ● A Master / Slave based system www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  4. 4. Apache Mesos – Beyond Hadoop What requirements are there beyond Hadoop ? ● Cluster sharing / multi tenancy ● Higher resource utilization ● Faster response times ● Resource sharing ● A wider range of functionality ● More out of the box functionality – Graphical Cluster monitoring – Graphical drag and drop cluster manipulation www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  5. 5. Apache Mesos – Resource Sharing www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  6. 6. Apache Mesos – Intentions ● Avoid multiple specialised clusters ● Avoid the need for “silo'ed” clusters ● Avoid the lower utilization that this brings ● Offer the ability for multi tenancy ● Which offers – – Higher utilisation – Scalability – ● Lower hardware / maintenance costs Higher fault tolerance Program for the Data Center www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  7. 7. Apache Mesos – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  8. 8. Apache Mesos – Users Companies using Mesos ● Air bnb ● Cloud Physics ● HubSpot ● Shopify ● Twitter ● Vimeo ● Among many others www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  9. 9. Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems
  10. 10. Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×