Your SlideShare is downloading. ×
Hadoop Release Plan Feb17
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Hadoop Release Plan Feb17

1,271
views

Published on


0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,271
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Fleshed out Context object API include JobClient
  • Transcript

    • 1. Hadoop Release Plans February 17th, 2010 Owen O'Malley, Yahoo! Hadoop Team
    • 2. Yahoo and 0.20
      • Yahoo back ported a lot of features from trunk into Yahoo’s 0.20
          • Back port features to support Yahoo needs
          • Keep our branch in Git and publish to GitHub
          • Has been deployed on all 25,000 nodes
          • Improved Capacity scheduler
          • Run tasks as users
          • Currently have Yahoo 0.20.8 deployed and Yahoo 0.20.9 being tested
      • I submitted Apache 0.20.2 rc2 today.
    • 3. The current state of Hadoop 0.21
      • Branched on 19 Sep 2009
      • Has a couple of big ticket items
          • HDFS sync/flush/append
          • Improved MapReduce schedulers
          • Run tasks as user
      • Lots of blockers still open 3 + 5 + 20
      • Some missing back ports
          • libhdfs is still in MapReduce!
      • Lots of grunt work left to do
    • 4. Yahoo and Security
      • Yahoo needs Hadoop Security
          • Finish development this month
          • Deploy first integration cluster in April
          • Deploy to production in August
          • Can’t afford to slip dates
          • Building on Yahoo 0.20 was lower risk
      • Created a new branch Yahoo 0.20.100
      • We will publish to GitHub.
    • 5. Going Forward
      • For Yahoo, Hadoop 0.21 will be very stale by the time it could be deployed.
      • For our customers, moving to 0.21 isn’t worth the cost in incompatibility.
      • Yahoo is planning on jumping straight from 0.20 with security to 0.22.
      • Is anyone outside of Yahoo interested enough in 0.21 to get it released?