Savanna project update Jan 2014
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Savanna project update Jan 2014

on

  • 826 views

 

Statistics

Views

Total Views
826
Views on SlideShare
826
Embed Views
0

Actions

Likes
0
Downloads
21
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Savanna project update Jan 2014 Presentation Transcript

  • 1. OpenStack Data Processing (Savanna) Project Update January 16, 2014 Sergey Lukjanov, Data Processing Program PTL
  • 2. Havana Release Overview ● ● ● ● ● ● 69 blueprints implemented ~150 bugs fixed 880 code commits from 31 people 3000+ code reviews officially incubated for Icehouse! more info: https://launchpad.net/savanna/havana ● 0.2 and 0.3 releases ● https://wiki.openstack.org/wiki/Savanna/ReleaseNotes
  • 3. Havana Highlights ● from PoC to community-backed project ● contributors ○ core: Mirantis, Hortonworks, Red Hat ○ plus: HP, IBM, UnitedStack, Rackspace ● two plugins: ○ Vanilla ○ Hortonworks Data Platform ● clustering ● Elastic Data Processing ● OpenStack Dashboard plugin
  • 4. Havana Highlights: Clustering ● ● ● ● ● cluster provisioning configuration management (templates) cluster scaling data nodes anti-affinity 200 nodes in 5 mins
  • 5. Havana Highlights: EDP ● API to execute MapReduce jobs without exposing details of underlying infrastructure ○ pluggable data sources: Swift ○ supported job types: jar, Pig, Hive ○ integration with Oozie for workflow management ● user-friendly UI for ad-hoc analytics queries based on Hive or Pig
  • 6. Icehouse Overview ● working on i-2 dev milestone now (release next week) ● so far: ○ ○ ○ ○ 24 blueprints implemented ~43 fixed 220 code commits from 26 people 1530+ code reviews ● more info: https://launchpad.net/savanna/icehouse
  • 7. Icehouse Highlights ● new contributors ○ eNovance, Samsung, Intel, EPAM Systems, Zurich University of Applied Science ● Heat integration for orchestration ● Intel Distribution of Hadoop plugin ● Gating Savanna (async) ○ DevStack integration ○ Tempest tests (base API) ● CLI proof of concept
  • 8. Icehouse plans ● ● ● ● ● Heat by default for orchestration Tempest: scenarios, CLI v2 API based on Pecan/WSME complete CLI implementation guest agents PoC
  • 9. Q&A email: slukjanov@mirantis.com irc: SergeyLukjanov on Freenode