Sahara provides scalable data processing in OpenStack by provisioning and operating data processing clusters and scheduling and operating jobs. It implements Elastic Data Processing for workflow management. The Juno release focused on code contributions from 50 people, implementing 32 blueprints and fixing 168 bugs. Plans for the Kilo release include support for new Hadoop/Spark versions, improved dashboards, better Heat integration and Ironic support.

1. Sergey Lukjanov
PTL
OpenStack Sahara
Data Processing Update

2. To provide a scalable data processing stack
and associated management interfaces Sahara
● provisions & operates data proc. clusters
● schedules & operates data proc. jobs /
workloads

3. Elastic Data Processing (EDP) is Sahara’s take
on data processing workflow management.

4. Juno release overview
● 540+ code commits from 50 people
● 32 blueprints implemented
● ~5000 code reviews
● ~168 bugs fixed
details: https://launchpad.net/sahara/juno

5. Moved to specs for new features

6. Sahara UI completely merged into Horizon

7. Pluggable framework-agnostic EDP

8. Vanilla Apache Hadoop 2.4.1 support
Cloudera Distribution of Apache Hadoop 5.X
support
Apache Spark 0.9.1 and 1.0.0 support

9. Ceilometer integration

10. Heat resources for Sahara available

11. Auto security groups creation

12. Kilo plans
● New versions for CDH, HDP, etc.
● Dashboard UX improvements
● Better Heat integration
● Ironic support