Savanna project update Jan 2014

  • 650 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
650
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
21
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. OpenStack Data Processing (Savanna) Project Update January 16, 2014 Sergey Lukjanov, Data Processing Program PTL
  • 2. Havana Release Overview ● ● ● ● ● ● 69 blueprints implemented ~150 bugs fixed 880 code commits from 31 people 3000+ code reviews officially incubated for Icehouse! more info: https://launchpad.net/savanna/havana ● 0.2 and 0.3 releases ● https://wiki.openstack.org/wiki/Savanna/ReleaseNotes
  • 3. Havana Highlights ● from PoC to community-backed project ● contributors ○ core: Mirantis, Hortonworks, Red Hat ○ plus: HP, IBM, UnitedStack, Rackspace ● two plugins: ○ Vanilla ○ Hortonworks Data Platform ● clustering ● Elastic Data Processing ● OpenStack Dashboard plugin
  • 4. Havana Highlights: Clustering ● ● ● ● ● cluster provisioning configuration management (templates) cluster scaling data nodes anti-affinity 200 nodes in 5 mins
  • 5. Havana Highlights: EDP ● API to execute MapReduce jobs without exposing details of underlying infrastructure ○ pluggable data sources: Swift ○ supported job types: jar, Pig, Hive ○ integration with Oozie for workflow management ● user-friendly UI for ad-hoc analytics queries based on Hive or Pig
  • 6. Icehouse Overview ● working on i-2 dev milestone now (release next week) ● so far: ○ ○ ○ ○ 24 blueprints implemented ~43 fixed 220 code commits from 26 people 1530+ code reviews ● more info: https://launchpad.net/savanna/icehouse
  • 7. Icehouse Highlights ● new contributors ○ eNovance, Samsung, Intel, EPAM Systems, Zurich University of Applied Science ● Heat integration for orchestration ● Intel Distribution of Hadoop plugin ● Gating Savanna (async) ○ DevStack integration ○ Tempest tests (base API) ● CLI proof of concept
  • 8. Icehouse plans ● ● ● ● ● Heat by default for orchestration Tempest: scenarios, CLI v2 API based on Pecan/WSME complete CLI implementation guest agents PoC
  • 9. Q&A email: slukjanov@mirantis.com irc: SergeyLukjanov on Freenode