Hadoop in a Box
Upcoming SlideShare
Loading in...5
×
 

Hadoop in a Box

on

  • 3,872 views

You can run Hadoop on pretty much any hardware out there, as it makes very few assumptions about its environment. In this talk I present the modular and highly energy-efficient storage server which is ...

You can run Hadoop on pretty much any hardware out there, as it makes very few assumptions about its environment. In this talk I present the modular and highly energy-efficient storage server which is currently being developed by the OpenStoragePod project.

I explain the motivations for basing our design on large numbers of 2.5" laptop disks, and discuss why you might want to consider using OpenStoragePod as the basis for building your (next) Hadoop cluster.

Statistics

Views

Total Views
3,872
Views on SlideShare
3,730
Embed Views
142

Actions

Likes
5
Downloads
54
Comments
0

4 Embeds 142

http://www.slideshare.net 112
http://speakerrate.com 22
http://adiefatlady.posterous.com 7
http://twittertim.es 1

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Hadoop in a Box Hadoop in a Box Presentation Transcript

  • Hadoop in a Box
  • @tlossen
  • flickr.com/photos/brent_nashville/2228396914
  • flickr.com/photos/bizkit/2698782365
  • data CPU
  • data S.E.T.I. CPU
  • data Avatar S.E.T.I. CPU
  • data most others Avatar S.E.T.I. CPU
  • History
  • 1956 ed-thelen.org
  • 1980 en.wikipedia.org
  • 2010
  • Open StoragePod
  • Mission
  • Return on Byte (ROB) = value to be extracted from byte / cost of storing that byte (Amr Awadallah, Cloudera)
  • Total Cost of Ownership Cap Ex OpEx
  • Total Cost of Ownership Cap Ex OpEx
  • Total Cost of Ownership Cap Ex OpEx
  • Total Cost of Ownership Cap Ex OpEx
  • Total Cost of Ownership Cap Ex OpenStoragePod OpEx
  • “Petascale storage for the rest of us”
  • Design
  • 3.5” 2.5” price €80 €180 power 3.4 W idle power 2.8 W weight 330 g volume 195 cm³
  • 3.5” 2.5” price €80 €180 power 3.4 W 1.7 W idle power 2.8 W 0.75 W weight 330 g 153 g volume 195 cm³ 88 cm³
  • Node 170 x 170 x 170 mm 100 W (12V) 20 TB (= 20 disks)
  • Pod 6 nodes, 4U 600 W (220V) 120 TB (= 120 disks)
  • Rack 10 pods 6 KW 1.2 PB (= 1200 disks)
  • Container 8 racks 48 KW 9.6 PB (= 9600 disks)
  • Status
  • Cube 140 x 140 x 140 mm 15 W (5V) 5 TB (= 5 disks)
  • Q&A
  • openstoragepod.org speakerrate.com/talks/3465