http://bit.ly/199GxWD – Project Myriad is the first resource management framework that allows Apache YARN jobs to run alongside other applications and services in enterprise and cloud datacenters.

1. ®
© 2015 MapR Technologies 1
®
© 2015 MapR Technologies

2. ®
© 2015 MapR Technologies 2
What is Myriad
• Allows Apache Mesos and Apache YARN to co-operate/integrate
with each other
• Mesos: datacenter-wide resource manager
– Containers used for isolation
• Hadoop is launched inside these containers
– Provided by Mesos
• Myriad manages conversation between Mesos and YARN
Resource Manager and Node Manager

3. ®
© 2015 MapR Technologies 3
Why Myriad
• Data Center Resource Optimization
• Run many types of compute frameworks side-by-side
– Hadoop family (YARN, Spark, Kafka, Storm, etc.)
– Web-server farm
– MPP databases (e.g. Vertica), custom jobs, etc.
• Each compute framework is a cluster in itself
• Need to break up a physical cluster into many virtual clusters
– Using containers for good isolation
– But most schedulers can only manage individual nodes inside a cluster
• Move resources between virtual clusters on-demand

4. ®
© 2015 MapR Technologies 4
Myriad Project Announcement
• MapR + Mesosphere are formally announcing the Myriad project
• Wider Community support from eBay and others
• Myriad will be incubated under the Apache Software Foundation
in Q1 2015
• Short-term project goals: Full life cycle management of YARN jobs
• Long-term goals: Security, Cloud, GUI, Logging, etc.
• Available on GitHub
Details

5. ®
© 2015 MapR Technologies 5
Utilize Excess Capacity for Analytics
DC Server Farm Hadoop Analytics
Utilizatiion
Long-lived excess
capacity situations
• “Scale up” Hadoop during long periods of low utilization
• “Scale down” Hadoop ahead of anticipated high utilization

6. ®
© 2015 MapR Technologies 6
How Myriad Works
ü Efficient resource utilization across the board
ü YARN jobs run alongside other jobs